Predicting the onset of diabetes

Introduction

Diabetes affects approximately 422 million people worldwide. There are currently 199 million women living with diabetes, and this number is projected to increase to 313 million by 2040. Approximately 2.1 million women die each year out of which, most deaths are premature.

Building a Deep Learning model that can classify whether a person is diabetic or not can have several benefits such as:

  1. It can help in early detection and diagnosis of diabetes, which is critical for effective management and prevention of complications.
  2. It can help in identifying individuals who are at risk of developing diabetes, allowing for early intervention and lifestyle modifications to prevent the onset of the disease.
  3. It can help in identifying patterns and risk factors associated with diabetes, which can aid in developing targeted prevention and treatment strategies.
  4. </ol>

    Aim

    In this project, I will be building a Deep Learning model on a dataset containing information of diagnostic measurements on female patients to predict if the patient has diabetes or not. Diabetes affects women differently than men, and there are several gender-specific risk factors associated with the disease such as:

    1. Gestational diabetes, which occurs during pregnancy, can increase a woman's risk of developing type 2 diabetes later in life.
    2. Women are also at a greater risk of blindness due to diabetic retinopathy
    3. Pre-menopausal women with diabetes lose the protection against heart disease that non-diabetic women have and are 50 per cent more likely to die from heart disease than men.
    4. </ol> Hence, developing a Deep Learning model that is specific to women can have various advantages such as:

      1. The model can help in identifying women who are at high risk of developing diabetes and can benefit from lifestyle modifications and interventions to prevent the onset of the disease.
      2. Women are often underrepresented in clinical studies and datasets. Thus, we can address this gender gap and help in developing targeted prevention and treatment strategies for women with diabetes.
      3. </ol>
        Referenced from: World Health Organization, "Diabetes", 2023.[Online]
        Available: https://www.who.int/health-topics/diabetes#tab=tab_1

        Referenced from: Indian J Med Res, "Women & diabetes: Our right to a healthy future", 2017.[Online]
        Available:https://www.ncbi.nlm.nih.gov/pmc/articles/PMC5861464/#:~:text=There%20are%20currently%20over%20199,them%20were%20pre%2Dmature1.

Data Quantity

The dataset may not contain all the diagnostic measures that can help to identify diabetes in women.

Data Quality

The dataset used does not contain external factors such as Geolocation of the patient, lifestyle and eating habits, average stress levels, and many other such factors that could also play a role in the cause of diabetes.

Importing the librarires

In [1]:
pip install -U seaborn
Collecting seaborn
  Downloading seaborn-0.12.2-py3-none-any.whl (293 kB)
     |████████████████████████████████| 293 kB 80.7 MB/s eta 0:00:01
Requirement already satisfied, skipping upgrade: numpy!=1.24.0,>=1.17 in /opt/conda/lib/python3.7/site-packages (from seaborn) (1.18.4)
Requirement already satisfied, skipping upgrade: pandas>=0.25 in /opt/conda/lib/python3.7/site-packages (from seaborn) (1.0.3)
Requirement already satisfied, skipping upgrade: typing_extensions; python_version < "3.8" in /opt/conda/lib/python3.7/site-packages (from seaborn) (3.7.4.2)
Requirement already satisfied, skipping upgrade: matplotlib!=3.6.1,>=3.1 in /opt/conda/lib/python3.7/site-packages (from seaborn) (3.2.1)
Requirement already satisfied, skipping upgrade: pytz>=2017.2 in /opt/conda/lib/python3.7/site-packages (from pandas>=0.25->seaborn) (2020.1)
Requirement already satisfied, skipping upgrade: python-dateutil>=2.6.1 in /opt/conda/lib/python3.7/site-packages (from pandas>=0.25->seaborn) (2.8.1)
Requirement already satisfied, skipping upgrade: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.1 in /opt/conda/lib/python3.7/site-packages (from matplotlib!=3.6.1,>=3.1->seaborn) (2.4.7)
Requirement already satisfied, skipping upgrade: kiwisolver>=1.0.1 in /opt/conda/lib/python3.7/site-packages (from matplotlib!=3.6.1,>=3.1->seaborn) (1.2.0)
Requirement already satisfied, skipping upgrade: cycler>=0.10 in /opt/conda/lib/python3.7/site-packages (from matplotlib!=3.6.1,>=3.1->seaborn) (0.10.0)
Requirement already satisfied, skipping upgrade: six>=1.5 in /opt/conda/lib/python3.7/site-packages (from python-dateutil>=2.6.1->pandas>=0.25->seaborn) (1.14.0)
Installing collected packages: seaborn
  Attempting uninstall: seaborn
    Found existing installation: seaborn 0.10.1
    Uninstalling seaborn-0.10.1:
      Successfully uninstalled seaborn-0.10.1
Successfully installed seaborn-0.12.2
Note: you may need to restart the kernel to use updated packages.
In [49]:
#library for arrays and linear algebra
import numpy as np

#data visualization libraries
import seaborn as sns
import matplotlib.pyplot as plt
from IPython.display import Markdown

#library for dataframe manipulation
import pandas as pd

#library for data-preprocessing and other ML tasks
from sklearn.experimental import enable_iterative_imputer
from sklearn.metrics import f1_score, precision_score, recall_score, confusion_matrix
from sklearn.impute import IterativeImputer
from sklearn.linear_model import LinearRegression
from sklearn.model_selection import train_test_split, KFold
from sklearn.preprocessing import StandardScaler
from sklearn.model_selection import GridSearchCV, cross_validate

#library for deep learning
import tensorflow as tf
from tensorflow.keras import models, layers, regularizers
from tensorflow.keras.optimizers import Adam
from tensorflow.keras.initializers import GlorotUniform
from tensorflow.keras.wrappers.scikit_learn import KerasClassifier
from tensorflow.keras.callbacks import EarlyStopping


#Setting the random seed to get the same result each time
myState = 30
np.random.seed(myState)
tf.random.set_seed(myState)

Importing the dataset

In [3]:
#The song dataset is taken from Kaggle, "Song Popularity Dataset", 2022.[Online]
#Available: https://www.kaggle.com/datasets/yasserh/song-popularity-dataset
#License: CC0: Public Domain

db_dataset = pd.read_csv('diabetes.csv')
db_dataset.head()
Out[3]:
Pregnancies Glucose BloodPressure SkinThickness Insulin BMI DiabetesPedigreeFunction Age Outcome
0 6 148 72 35 0 33.6 0.627 50 1
1 1 85 66 29 0 26.6 0.351 31 0
2 8 183 64 0 0 23.3 0.672 32 1
3 1 89 66 23 94 28.1 0.167 21 0
4 0 137 40 35 168 43.1 2.288 33 1

Exploratory Data Analysis

In [4]:
#checking the data types of all the columns
db_dataset.info()
print("------------------------------------------------------")
print("Number of null values in features")
print(db_dataset.isnull().sum())
<class 'pandas.core.frame.DataFrame'>
RangeIndex: 768 entries, 0 to 767
Data columns (total 9 columns):
 #   Column                    Non-Null Count  Dtype  
---  ------                    --------------  -----  
 0   Pregnancies               768 non-null    int64  
 1   Glucose                   768 non-null    int64  
 2   BloodPressure             768 non-null    int64  
 3   SkinThickness             768 non-null    int64  
 4   Insulin                   768 non-null    int64  
 5   BMI                       768 non-null    float64
 6   DiabetesPedigreeFunction  768 non-null    float64
 7   Age                       768 non-null    int64  
 8   Outcome                   768 non-null    int64  
dtypes: float64(2), int64(7)
memory usage: 54.1 KB
------------------------------------------------------
Number of null values in features
Pregnancies                 0
Glucose                     0
BloodPressure               0
SkinThickness               0
Insulin                     0
BMI                         0
DiabetesPedigreeFunction    0
Age                         0
Outcome                     0
dtype: int64

This dataset contains 8 Columns with no null or missing values. All features are numerical and hence no encoding is required.

In [5]:
#To check the number of unique records from each feature 
#and sorting them in ascending order

#referenced from: Rajput-Ji, "Get unique values from a column in Pandas DataFrame", 2018.[Online]
#Available: https://www.geeksforgeeks.org/get-unique-values-from-a-column-in-pandas-dataframe/

db_dataset.nunique().sort_values()
Out[5]:
Outcome                       2
Pregnancies                  17
BloodPressure                47
SkinThickness                51
Age                          52
Glucose                     136
Insulin                     186
BMI                         248
DiabetesPedigreeFunction    517
dtype: int64
In [6]:
# Visualisation of Outcome split

# counting the number of 0's and 1's in the outcome column
outcome_count = db_dataset['Outcome'].value_counts()

# creating a pie chart showing the split percentage of 0's and 1's
my_labels = ['Num of 0s', 'Num of 1s']
explosion = [0.1, 0]
plt.pie(outcome_count,
        labels = my_labels, 
        explode = explosion, 
        shadow = True,
        autopct='%1.1f%%', 
        startangle = 65)
plt.title('Outcome Distribution')
plt.show()

The number of 0 outcomes is almost double the number of 1 outcomes, which means that the data is biased towards patients that do not have diabetes.

In [7]:
#visualization of data spread in individual features before imputing.
#Histplot referenced from: Roy G Kr, "Seaborn histplot (Visualize data with histograms)", 2022.[Online]
#Available: https://likegeeks.com/seaborn-histplot/
#Subplot referenced from: Bruno T, "Subplotting with matplotlib and seaborn", 2020.[Online]
#Available: https://dev.to/thalesbruno/subplotting-with-matplotlib-and-seaborn-5ei8

plt.figure(figsize=(15,10))
display(Markdown(f"<h2><center>Data spread of Individual Features before imputing</center></h2>"))
for i in range(len(db_dataset.columns)):
    plt.subplot(3,3, i+1)
    sns.histplot(db_dataset[db_dataset.columns[i]], 
                 bins=30, 
                 kde=True, 
                 color=list(np.random.randint([255,255,255])/255))    #To create a color with random RGB values
plt.tight_layout()
plt.show()

Data spread of Individual Features before imputing

The pregnancy feature has data of patients who were pregnant 17 and 15 times. This number seems strange as it is quite high and could be a possible outlier. Hence, I will remove observations that are more than 7 pregnancies.

In [8]:
#Removing rows from dataset where value of Pregnancy is greater than 8
db_dataset2 = db_dataset[db_dataset['Pregnancies'] <= 8]

# Creating a new DataFrame with corrected indexing
db_dataset2 = db_dataset2.reset_index(drop=True)
db_dataset2
Out[8]:
Pregnancies Glucose BloodPressure SkinThickness Insulin BMI DiabetesPedigreeFunction Age Outcome
0 6 148 72 35 0 33.6 0.627 50 1
1 1 85 66 29 0 26.6 0.351 31 0
2 8 183 64 0 0 23.3 0.672 32 1
3 1 89 66 23 94 28.1 0.167 21 0
4 0 137 40 35 168 43.1 2.288 33 1
... ... ... ... ... ... ... ... ... ...
677 2 88 58 26 16 28.4 0.766 22 0
678 2 122 70 27 0 36.8 0.340 27 0
679 5 121 72 23 112 26.2 0.245 30 0
680 1 126 60 0 0 30.1 0.349 47 1
681 1 93 70 31 0 30.4 0.315 23 0

682 rows × 9 columns

In [9]:
#Getting number of values that are equal to 0 in each column
num_zeros = (db_dataset == 0).sum()
num_zeros
Out[9]:
Pregnancies                 111
Glucose                       5
BloodPressure                35
SkinThickness               227
Insulin                     374
BMI                          11
DiabetesPedigreeFunction      0
Age                           0
Outcome                     500
dtype: int64

From the information above, it can be concurred that some of the data is incorrect or missing because diagnostic measures such as Glucose, Blood Pressure, Skin Thickness, Insulin, BMI cannot be 0. In the cases of Skin Thickness and BMI, it may be possible to have a value of 0 but is extremely unlikely. A value of 0 for Insulin is more plausible as some patients may not produce any insulin naturally, but this is not the case for all patients. Hence, I will replace the 0 values in these 5 columns using the Random Forest Imputer. I will do this in the Data Manipulation section before splitting the data into the training set and test set.

In [10]:
#visualizing and understanding the relationship between all features before imputing

#code adapted from: creanion, "Reduce number of plots in sns.pairplot()", 2021.[Online].
#Available:https://stackoverflow.com/questions/53717543/reduce-number-of-plots-in-sns-pairplot

sns.set_style('darkgrid')


hue = 'Outcome'
features_per_line = 4
all_features = list(db_dataset2.columns.symmetric_difference([hue]))
display(Markdown(f"<h1><center>Relationship b/w all features before imputing</center></h1>"))

for feature in all_features:
    features_left = list(all_features)
    features_left.remove(feature)
    display(Markdown(f"## {feature}"))
    while features_left:
        line_feature = features_left[:features_per_line]
        del features_left[:features_per_line]
        feature_name = ", ".join(line_feature)
        display(Markdown(f"### {feature} vs {feature_name}"))
        sns.pairplot(db_dataset2,
                     x_vars=line_feature, 
                     y_vars=[feature],
                     hue=hue,
                     palette='magma', )
        plt.show()
        plt.close()

Relationship b/w all features before imputing

Age

Age vs BMI, BloodPressure, DiabetesPedigreeFunction, Glucose

Age vs Insulin, Pregnancies, SkinThickness

BMI

BMI vs Age, BloodPressure, DiabetesPedigreeFunction, Glucose

BMI vs Insulin, Pregnancies, SkinThickness

BloodPressure

BloodPressure vs Age, BMI, DiabetesPedigreeFunction, Glucose

BloodPressure vs Insulin, Pregnancies, SkinThickness

DiabetesPedigreeFunction

DiabetesPedigreeFunction vs Age, BMI, BloodPressure, Glucose

DiabetesPedigreeFunction vs Insulin, Pregnancies, SkinThickness

Glucose

Glucose vs Age, BMI, BloodPressure, DiabetesPedigreeFunction

Glucose vs Insulin, Pregnancies, SkinThickness

Insulin

Insulin vs Age, BMI, BloodPressure, DiabetesPedigreeFunction

Insulin vs Glucose, Pregnancies, SkinThickness

Pregnancies

Pregnancies vs Age, BMI, BloodPressure, DiabetesPedigreeFunction

Pregnancies vs Glucose, Insulin, SkinThickness

SkinThickness

SkinThickness vs Age, BMI, BloodPressure, DiabetesPedigreeFunction

SkinThickness vs Glucose, Insulin, Pregnancies

Dataset summary:

  • Problem: Binary classification to predict the onset of dibetes
  • Data Balance: Imbalanced (More 0's than 1's)
  • Data Stucture: Structured data
  • Input Features: Pregnancies, Glucose, Blood Pressure, Skin Thickness, Insulin, BMI, Diabetes Pedigree Function and Age
  • Output Variable: Outcome - 0 if the patient does not have diabetes and 1 if the patient does have diabetes

Data Manipulation

In [11]:
# making a copy of the original dataset
db_dataset3 = db_dataset2.copy() 
In [12]:
#Converting the 0 values to NaN before imputing
db_dataset3[['Glucose',
            'BloodPressure',
            'SkinThickness',
            'Insulin',
            'BMI']] = db_dataset3[['Glucose',
                                  'BloodPressure',
                                  'SkinThickness',
                                  'Insulin',
                                  'BMI']].replace(0,np.NaN)
db_dataset3[['Glucose','BloodPressure','SkinThickness','Insulin','BMI']].head()
Out[12]:
Glucose BloodPressure SkinThickness Insulin BMI
0 148.0 72.0 35.0 NaN 33.6
1 85.0 66.0 29.0 NaN 26.6
2 183.0 64.0 NaN NaN 23.3
3 89.0 66.0 23.0 94.0 28.1
4 137.0 40.0 35.0 168.0 43.1
In [13]:
#Using iterative imputer to impute the missing values

#referenced from: Hoque G., "A Better Way to Handle Missing Values in your Dataset: Using IterativeImputer (PART I)",
#2021.[Online]
#Available:https://towardsdatascience.com/a-better-way-to-handle-missing-values-in-your-dataset-using-iterativeimputer-9e6e84857d98#:~:text=Iterative%20Imputer%20initially%20initializes%20the,of%20the%20round%2Drobin%20imputation.

impute_cols = db_dataset3[['Glucose','BloodPressure','SkinThickness','Insulin','BMI']]
lin_reg = LinearRegression()
imp = IterativeImputer(estimator = lin_reg, 
                       missing_values = np.nan,
                       max_iter =5, 
                       verbose = 2, 
                       imputation_order = "roman",
                       random_state = myState)

This imputer performs better as compared to the other imputers tested such as:
Simple Imputer - Is incorrect to just take the average for each feature.
Random Forest Imputer - Using missForest() from the missingpy package. Performace was lower than Iterative Imputer
Multiple imputer - Using miceforest from the miceforest package. It was computationally very intensive.

In [14]:
imputed_data = imp.fit_transform(impute_cols)
[IterativeImputer] Completing matrix with shape (682, 5)
[IterativeImputer] Ending imputation round 1/5, elapsed time 0.08
[IterativeImputer] Change: 201.0778577631089, scaled tolerance: 0.846 
[IterativeImputer] Ending imputation round 2/5, elapsed time 0.08
[IterativeImputer] Change: 6.476932719926538, scaled tolerance: 0.846 
[IterativeImputer] Ending imputation round 3/5, elapsed time 0.08
[IterativeImputer] Change: 3.0920478843346046, scaled tolerance: 0.846 
[IterativeImputer] Ending imputation round 4/5, elapsed time 0.09
[IterativeImputer] Change: 1.483310660721692, scaled tolerance: 0.846 
[IterativeImputer] Ending imputation round 5/5, elapsed time 0.09
[IterativeImputer] Change: 0.7114706275018037, scaled tolerance: 0.846 
[IterativeImputer] Early stopping criterion reached.
In [15]:
X_imputed = pd.DataFrame(imputed_data)
db_dataset3[['Glucose',
             'BloodPressure',
             'SkinThickness',
             'Insulin',
             'BMI']] = X_imputed
In [16]:
db_dataset3
Out[16]:
Pregnancies Glucose BloodPressure SkinThickness Insulin BMI DiabetesPedigreeFunction Age Outcome
0 6 148.0 72.0 35.000000 218.563701 33.6 0.627 50 1
1 1 85.0 66.0 29.000000 62.876455 26.6 0.351 31 0
2 8 183.0 64.0 21.320155 282.652582 23.3 0.672 32 1
3 1 89.0 66.0 23.000000 94.000000 28.1 0.167 21 0
4 0 137.0 40.0 35.000000 168.000000 43.1 2.288 33 1
... ... ... ... ... ... ... ... ... ...
677 2 88.0 58.0 26.000000 16.000000 28.4 0.766 22 0
678 2 122.0 70.0 27.000000 162.234249 36.8 0.340 27 0
679 5 121.0 72.0 23.000000 112.000000 26.2 0.245 30 0
680 1 126.0 60.0 26.311024 164.539536 30.1 0.349 47 1
681 1 93.0 70.0 31.000000 86.314947 30.4 0.315 23 0

682 rows × 9 columns

In [17]:
#Splitting the dataframe into dependent and independent variables

#getting all Independent variables
X = db_dataset3.iloc[:, :-1].values

#getting the Dependent variable vector which is in the 1st column
y = db_dataset3.iloc[:, -1].values
In [18]:
#visualization of data spread in individual features after imputing.

#Histplot referenced from: Roy G Kr, "Seaborn histplot (Visualize data with histograms)", 2022.[Online]
#Available: https://likegeeks.com/seaborn-histplot/

#Subplot referenced from: Bruno T, "Subplotting with matplotlib and seaborn", 2020.[Online]
#Available: https://dev.to/thalesbruno/subplotting-with-matplotlib-and-seaborn-5ei8

plt.figure(figsize=(15,10))
display(Markdown(f"<h2><center>Data spread of Individual Features after imputing</center></h2>"))
for i in range(len(db_dataset3.columns)):
    plt.subplot(3,3, i+1)
    sns.histplot(db_dataset3[db_dataset3.columns[i]], 
                 bins=30, 
                 kde=True, 
                 color=list(np.random.randint([255,255,255])/255))    #To create a color with random RGB values
plt.tight_layout()
plt.show()

Data spread of Individual Features after imputing

In [19]:
#visualizing and understanding the relationship between all features after imputing

#code adapted from: creanion, "Reduce number of plots in sns.pairplot()", 2021.[Online].
#Available:https://stackoverflow.com/questions/53717543/reduce-number-of-plots-in-sns-pairplot

sns.set_style('darkgrid')


hue = 'Outcome'
features_per_line = 4
all_features = list(db_dataset3.columns.symmetric_difference([hue]))
display(Markdown(f"<h1><center>Relationship b/w all features after imputing</center></h1>"))

for feature in all_features:
    features_left = list(all_features)
    features_left.remove(feature)
    display(Markdown(f"## {feature}"))
    while features_left:
        line_feature = features_left[:features_per_line]
        del features_left[:features_per_line]
        feature_name = ", ".join(line_feature)
        display(Markdown(f"### {feature} vs {feature_name}"))
        sns.pairplot(db_dataset3,
                     x_vars=line_feature, 
                     y_vars=[feature],
                     hue=hue,
                     palette='crest', )
        plt.show()
        plt.close()

Relationship b/w all features after imputing

Age

Age vs BMI, BloodPressure, DiabetesPedigreeFunction, Glucose

Age vs Insulin, Pregnancies, SkinThickness

BMI

BMI vs Age, BloodPressure, DiabetesPedigreeFunction, Glucose

BMI vs Insulin, Pregnancies, SkinThickness

BloodPressure

BloodPressure vs Age, BMI, DiabetesPedigreeFunction, Glucose

BloodPressure vs Insulin, Pregnancies, SkinThickness

DiabetesPedigreeFunction

DiabetesPedigreeFunction vs Age, BMI, BloodPressure, Glucose

DiabetesPedigreeFunction vs Insulin, Pregnancies, SkinThickness

Glucose

Glucose vs Age, BMI, BloodPressure, DiabetesPedigreeFunction

Glucose vs Insulin, Pregnancies, SkinThickness

Insulin

Insulin vs Age, BMI, BloodPressure, DiabetesPedigreeFunction

Insulin vs Glucose, Pregnancies, SkinThickness

Pregnancies

Pregnancies vs Age, BMI, BloodPressure, DiabetesPedigreeFunction

Pregnancies vs Glucose, Insulin, SkinThickness

SkinThickness

SkinThickness vs Age, BMI, BloodPressure, DiabetesPedigreeFunction

SkinThickness vs Glucose, Insulin, Pregnancies

In [20]:
#Visualizing the correlation through a heatmap before imputing 

#referenced from: Seaborn, "seaborn.heatmap", 2022.[Online]
#Available: https://seaborn.pydata.org/generated/seaborn.heatmap.html

plt.figure(figsize=[15,10])
sns.set(font_scale = 1.25)
corr_heatmap = sns.heatmap(db_dataset2.corr(),
                           annot = True,
                           fmt = '.2f',
                           center = 0,
                           linewidth = 2,
                           linecolor='pink',
                           square = True,
                           annot_kws={
                               'fontsize':12, 
                               'fontweight':'bold'
                           });
plt.title("Relationship b/w all features before imputing", 
          weight = 'bold'
         ).set_fontsize('18')
plt.show()
In [21]:
#Visualizing the correlation through a heatmap after imputing 

#referenced from: Seaborn, "seaborn.heatmap", 2022.[Online]
#Available: https://seaborn.pydata.org/generated/seaborn.heatmap.html

plt.figure(figsize=[15,10])
sns.set(font_scale = 1.25)
corr_heatmap = sns.heatmap(db_dataset3.corr(),
                           annot = True,
                           fmt = '.2f',
                           center = 0,
                           linewidth = 2,
                           linecolor='pink',
                           square = True,
                           annot_kws={
                               'fontsize':12, 
                               'fontweight':'bold'
                           });
plt.title("Relationship b/w all features after imputing", 
          weight = 'bold'
         ).set_fontsize('18')
plt.show()

After imputing, Insulin, Skin Thickness and Age are positively correlated with the other features. The correlation between the imputed features has also slightly increased.

In [22]:
#Splitting the data into training, validation and test sets
X_trainval, X_test, y_trainval, y_test = train_test_split(X, y, test_size=0.25, random_state = myState)

X_train, X_val, y_train, y_val = train_test_split(X_trainval, y_trainval, test_size=0.25, random_state = myState)

Feature Scaling

I will be performing Standardization in this scenario to scale the features as I will be building an ANN model that does Binary Classification with ReLU activation functions in the input and hidden layers and the Sigmoid activation function in the output layer. It is generally recommended to Standardiztion in these cases as Standardization transforms the data to have a mean of 0 and a standard deviation of 1. This can make it easier for the ReLU activation function to operate effectively. Additionally, Standardization does not have the same range restrictions as Normalization, so it can be used with the Sigmoid function in the output layer without issues.

In [23]:
#Feature scaling using standardization

sc = StandardScaler()

# fitting the scaler to the training data
sc.fit(X_train)

# transforming the training, validation and testing data
X_train_scaled = sc.transform(X_train)

X_val_scaled = sc.transform(X_val)

X_test_scaled = sc.transform(X_test)

Developing a model that does better than a baseline

In [24]:
#Building a baseline
baseline = outcome_count[0]/ outcome_count.sum()             #outcome_count is the var created above in the pie chart
print("Baseline accuracy:", baseline)
Baseline accuracy: 0.6510416666666666
In [25]:
#Developing a model that has a better score than the baseline

lrn_rate = 0.0015
#Building the model
def create_model():
    ann_simple = models.Sequential()
    ann_simple.add(layers.Dense(units = 8,
                                input_dim = 8,
                                activation = "relu",
                                kernel_initializer=tf.keras.initializers.GlorotUniform(seed=myState)))
    ann_simple.add(layers.Dense(units = 1,
                                activation = "sigmoid",
                                kernel_initializer = tf.keras.initializers.GlorotUniform(seed=myState)))
    ann_simple.compile(optimizer=Adam(lr = lrn_rate),
                       loss="binary_crossentropy",
                       metrics=["accuracy"])
    return ann_simple
In [26]:
# Creating a KerasClassifier based on the create_model function
b_size = 64
num_epochs = 100
build = KerasClassifier(build_fn = create_model,
                        batch_size = b_size,
                        epochs = num_epochs)

# Fitting the model on the training set and validate on the validation set
early_stopping = EarlyStopping(monitor='val_loss',
                               patience=5,
                               restore_best_weights=True)

history = build.fit(X_train_scaled,
                    y_train,
                    validation_data=(X_val_scaled, y_val),
                    callbacks=[early_stopping])

# Evaluating the model on the training and validation sets
train_loss, train_accuracy = build.model.evaluate(X_train_scaled,
                                                  y_train,
                                                  verbose = False)


val_loss, val_accuracy = build.model.evaluate(X_val_scaled,
                                              y_val,
                                              verbose = False)
Epoch 1/100
6/6 [==============================] - 0s 37ms/step - loss: 0.7686 - accuracy: 0.5039 - val_loss: 0.7469 - val_accuracy: 0.5469
Epoch 2/100
6/6 [==============================] - 0s 13ms/step - loss: 0.7475 - accuracy: 0.5352 - val_loss: 0.7287 - val_accuracy: 0.5938
Epoch 3/100
6/6 [==============================] - 0s 2ms/step - loss: 0.7291 - accuracy: 0.5822 - val_loss: 0.7106 - val_accuracy: 0.6250
Epoch 4/100
6/6 [==============================] - 0s 15ms/step - loss: 0.7093 - accuracy: 0.6110 - val_loss: 0.6934 - val_accuracy: 0.6562
Epoch 5/100
6/6 [==============================] - 0s 2ms/step - loss: 0.6919 - accuracy: 0.6475 - val_loss: 0.6768 - val_accuracy: 0.6953
Epoch 6/100
6/6 [==============================] - 0s 14ms/step - loss: 0.6745 - accuracy: 0.6815 - val_loss: 0.6606 - val_accuracy: 0.7188
Epoch 7/100
6/6 [==============================] - 0s 14ms/step - loss: 0.6577 - accuracy: 0.7050 - val_loss: 0.6454 - val_accuracy: 0.7422
Epoch 8/100
6/6 [==============================] - 0s 2ms/step - loss: 0.6412 - accuracy: 0.7076 - val_loss: 0.6304 - val_accuracy: 0.7344
Epoch 9/100
6/6 [==============================] - 0s 14ms/step - loss: 0.6265 - accuracy: 0.7154 - val_loss: 0.6157 - val_accuracy: 0.7500
Epoch 10/100
6/6 [==============================] - 0s 2ms/step - loss: 0.6114 - accuracy: 0.7232 - val_loss: 0.6015 - val_accuracy: 0.7656
Epoch 11/100
6/6 [==============================] - 0s 15ms/step - loss: 0.5966 - accuracy: 0.7311 - val_loss: 0.5882 - val_accuracy: 0.7734
Epoch 12/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5836 - accuracy: 0.7363 - val_loss: 0.5753 - val_accuracy: 0.7812
Epoch 13/100
6/6 [==============================] - 0s 15ms/step - loss: 0.5704 - accuracy: 0.7467 - val_loss: 0.5629 - val_accuracy: 0.7812
Epoch 14/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5586 - accuracy: 0.7546 - val_loss: 0.5507 - val_accuracy: 0.7734
Epoch 15/100
6/6 [==============================] - 0s 14ms/step - loss: 0.5466 - accuracy: 0.7624 - val_loss: 0.5394 - val_accuracy: 0.7656
Epoch 16/100
6/6 [==============================] - 0s 3ms/step - loss: 0.5360 - accuracy: 0.7676 - val_loss: 0.5287 - val_accuracy: 0.7656
Epoch 17/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5258 - accuracy: 0.7755 - val_loss: 0.5189 - val_accuracy: 0.7656
Epoch 18/100
6/6 [==============================] - 0s 14ms/step - loss: 0.5168 - accuracy: 0.7859 - val_loss: 0.5093 - val_accuracy: 0.7656
Epoch 19/100
6/6 [==============================] - 0s 3ms/step - loss: 0.5081 - accuracy: 0.7885 - val_loss: 0.5004 - val_accuracy: 0.7656
Epoch 20/100
6/6 [==============================] - 0s 14ms/step - loss: 0.5000 - accuracy: 0.7885 - val_loss: 0.4918 - val_accuracy: 0.7734
Epoch 21/100
6/6 [==============================] - 0s 3ms/step - loss: 0.4923 - accuracy: 0.7859 - val_loss: 0.4843 - val_accuracy: 0.7734
Epoch 22/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4859 - accuracy: 0.7911 - val_loss: 0.4769 - val_accuracy: 0.7734
Epoch 23/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4796 - accuracy: 0.7937 - val_loss: 0.4702 - val_accuracy: 0.7734
Epoch 24/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4742 - accuracy: 0.7859 - val_loss: 0.4642 - val_accuracy: 0.7891
Epoch 25/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4693 - accuracy: 0.7937 - val_loss: 0.4589 - val_accuracy: 0.7812
Epoch 26/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4652 - accuracy: 0.7937 - val_loss: 0.4539 - val_accuracy: 0.7891
Epoch 27/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4611 - accuracy: 0.7911 - val_loss: 0.4496 - val_accuracy: 0.7969
Epoch 28/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4580 - accuracy: 0.7963 - val_loss: 0.4454 - val_accuracy: 0.7969
Epoch 29/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4545 - accuracy: 0.8042 - val_loss: 0.4419 - val_accuracy: 0.7891
Epoch 30/100
6/6 [==============================] - 0s 14ms/step - loss: 0.4519 - accuracy: 0.8016 - val_loss: 0.4386 - val_accuracy: 0.7891
Epoch 31/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4495 - accuracy: 0.8042 - val_loss: 0.4356 - val_accuracy: 0.7891
Epoch 32/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4472 - accuracy: 0.8042 - val_loss: 0.4327 - val_accuracy: 0.7969
Epoch 33/100
6/6 [==============================] - 0s 3ms/step - loss: 0.4452 - accuracy: 0.8068 - val_loss: 0.4305 - val_accuracy: 0.7969
Epoch 34/100
6/6 [==============================] - 0s 14ms/step - loss: 0.4436 - accuracy: 0.8068 - val_loss: 0.4281 - val_accuracy: 0.7969
Epoch 35/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4419 - accuracy: 0.8068 - val_loss: 0.4262 - val_accuracy: 0.7969
Epoch 36/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4403 - accuracy: 0.8094 - val_loss: 0.4246 - val_accuracy: 0.7891
Epoch 37/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4391 - accuracy: 0.8120 - val_loss: 0.4230 - val_accuracy: 0.7969
Epoch 38/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4377 - accuracy: 0.8120 - val_loss: 0.4217 - val_accuracy: 0.7969
Epoch 39/100
6/6 [==============================] - 0s 3ms/step - loss: 0.4365 - accuracy: 0.8094 - val_loss: 0.4206 - val_accuracy: 0.7969
Epoch 40/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4356 - accuracy: 0.8094 - val_loss: 0.4195 - val_accuracy: 0.7969
Epoch 41/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4347 - accuracy: 0.8120 - val_loss: 0.4186 - val_accuracy: 0.7969
Epoch 42/100
6/6 [==============================] - 0s 14ms/step - loss: 0.4338 - accuracy: 0.8120 - val_loss: 0.4176 - val_accuracy: 0.7969
Epoch 43/100
6/6 [==============================] - 0s 3ms/step - loss: 0.4329 - accuracy: 0.8120 - val_loss: 0.4170 - val_accuracy: 0.7969
Epoch 44/100
6/6 [==============================] - 0s 14ms/step - loss: 0.4321 - accuracy: 0.8120 - val_loss: 0.4165 - val_accuracy: 0.7969
Epoch 45/100
6/6 [==============================] - 0s 3ms/step - loss: 0.4312 - accuracy: 0.8120 - val_loss: 0.4160 - val_accuracy: 0.7969
Epoch 46/100
6/6 [==============================] - 0s 14ms/step - loss: 0.4306 - accuracy: 0.8120 - val_loss: 0.4155 - val_accuracy: 0.7969
Epoch 47/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4300 - accuracy: 0.8120 - val_loss: 0.4148 - val_accuracy: 0.7969
Epoch 48/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4293 - accuracy: 0.8120 - val_loss: 0.4145 - val_accuracy: 0.7969
Epoch 49/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4285 - accuracy: 0.8120 - val_loss: 0.4143 - val_accuracy: 0.7969
Epoch 50/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4280 - accuracy: 0.8120 - val_loss: 0.4140 - val_accuracy: 0.7969
Epoch 51/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4275 - accuracy: 0.8120 - val_loss: 0.4137 - val_accuracy: 0.7969
Epoch 52/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4267 - accuracy: 0.8120 - val_loss: 0.4137 - val_accuracy: 0.7969
Epoch 53/100
6/6 [==============================] - 0s 3ms/step - loss: 0.4261 - accuracy: 0.8120 - val_loss: 0.4135 - val_accuracy: 0.7969
Epoch 54/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4257 - accuracy: 0.8120 - val_loss: 0.4133 - val_accuracy: 0.7969
Epoch 55/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4250 - accuracy: 0.8068 - val_loss: 0.4133 - val_accuracy: 0.7969
Epoch 56/100
6/6 [==============================] - 0s 14ms/step - loss: 0.4245 - accuracy: 0.8068 - val_loss: 0.4134 - val_accuracy: 0.7969
Epoch 57/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4240 - accuracy: 0.8068 - val_loss: 0.4132 - val_accuracy: 0.7969
Epoch 58/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4236 - accuracy: 0.8068 - val_loss: 0.4133 - val_accuracy: 0.7969
Epoch 59/100
6/6 [==============================] - 0s 3ms/step - loss: 0.4232 - accuracy: 0.8068 - val_loss: 0.4132 - val_accuracy: 0.7969
Epoch 60/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4227 - accuracy: 0.8094 - val_loss: 0.4135 - val_accuracy: 0.7969
Epoch 61/100
6/6 [==============================] - 0s 3ms/step - loss: 0.4224 - accuracy: 0.8120 - val_loss: 0.4135 - val_accuracy: 0.7969
Epoch 62/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4219 - accuracy: 0.8120 - val_loss: 0.4137 - val_accuracy: 0.7969
In [27]:
#Printing the training and validation accuracies of the SLP model.
print("Training accuracy: {:.2f}%".format(train_accuracy * 100))
print("Validation accuracy: {:.2f}%".format(val_accuracy * 100))
Training accuracy: 80.68%
Validation accuracy: 79.69%

The Single Layer Perceptron model has a better accuracy score as compared to the baseline.

In [28]:
# plotting the training and validation loss over each epoch
plt.plot(history.history['loss'])
plt.plot(history.history['val_loss'])
plt.title('Training and Validation Loss')
plt.xlabel('Epochs')
plt.ylabel('Loss')
plt.legend(['training', 'validation'],
           loc='upper right')
plt.show()

# plotting the training and validation accuracy over each epoch
plt.plot(history.history['accuracy'])
plt.plot(history.history['val_accuracy'])
plt.title('Training and Validation Accuracy')
plt.xlabel('Epochs')
plt.ylabel('Accuracy')
plt.legend(['training', 'validation'],
           loc='lower right')
plt.show()

Model Summary:

  • Hypothesis: The Single Layer Perceptron model is able to predict if a patient has diabetes or not based on the given features with an accuracy of 80.9%. Hence, the input data available seems to be sufficiently informative to predict the output data.
  • No. of Hidden Layers: 0 - Built a Single Layer Perceptron as a simple model to beat the baseline accuracy.
  • No. of Neurons: 8
  • Optimizer: Adam
  • Learning Rate: 0.003
  • Loss Function: Binary Cross Entropy - Because its a binary classification
  • Batch Size: 64
  • No. of Epochs: 100

Scaling up: Developing a model that overfits

I will attempt to overfit the model by adding a hidden layer with the same number of neurons as the input layer. I will also increase the number of epochs to 300 and by removing early stopping.

In [29]:
#Model parameters refrenced from:
#Gaurav M.,"How to find the optimum number of hidden layers and nodes in a neural network model?", 2019. [Online].
#Available: https://datagraphi.com/blog/post/2019/12/17/how-to-find-the-optimum-number-of-hidden-layers-and-nodes-in-a-neural-network-model

def overfit_model(num_layers=1, neurons=8, optimizer='adam', lrn_rate = 0.0015):
    ann_overfit = models.Sequential()
    ann_overfit.add(layers.Dense(units=neurons,
                                 input_dim=8,
                                 activation="relu",
                                 kernel_initializer=GlorotUniform(seed=myState)))
    
    for i in range(num_layers):
        ann_overfit.add(layers.Dense(units=neurons,
                                     activation="relu",
                                     kernel_initializer=GlorotUniform(seed=myState)))
    
    ann_overfit.add(layers.Dense(units=1,
                                 activation="sigmoid",
                                 kernel_initializer=GlorotUniform(seed=myState)))
    
    ann_overfit.compile(optimizer=optimizer,
                        loss="binary_crossentropy",
                        metrics=["accuracy"])
    
    return ann_overfit
In [30]:
# Creating a KerasClassifier based on the overfit_model function
b_size = 64
num_epochs = 300
overfit_build = KerasClassifier(build_fn = overfit_model,
                        batch_size = b_size,
                        epochs = num_epochs)

# Fitting the model on the training set and validating on the validation set
overfit_history = overfit_build.fit(X_train_scaled, y_train, validation_data=(X_val_scaled, y_val))

# Evaluating the model on the training and validation sets
y_train_pred = overfit_build.predict(X_train_scaled)
y_val_pred = overfit_build.predict(X_val_scaled)


# Calculating the accuracy, F1 score, precision, and recall for training set
overfit_train_loss, overfit_train_accuracy = overfit_build.model.evaluate(X_train_scaled,
                                                  y_train,
                                                  verbose = False)
overfit_f1_train = f1_score(y_train, y_train_pred)
overfit_precision_train = precision_score(y_train, y_train_pred)
overfit_recall_train = recall_score(y_train, y_train_pred)

# Calculating the F1 score, precision, and recall for validation set

overfit_val_loss, overfit_val_accuracy = overfit_build.model.evaluate(X_val_scaled,
                                              y_val,
                                              verbose = False)
overfit_f1_val = f1_score(y_val, y_val_pred)
overfit_precision_val = precision_score(y_val, y_val_pred)
overfit_recall_val = recall_score(y_val, y_val_pred)
Epoch 1/300
6/6 [==============================] - 0s 36ms/step - loss: 0.6546 - accuracy: 0.6632 - val_loss: 0.6449 - val_accuracy: 0.6328
Epoch 2/300
6/6 [==============================] - 0s 14ms/step - loss: 0.6415 - accuracy: 0.6710 - val_loss: 0.6342 - val_accuracy: 0.6562
Epoch 3/300
6/6 [==============================] - 0s 2ms/step - loss: 0.6301 - accuracy: 0.6867 - val_loss: 0.6233 - val_accuracy: 0.6562
Epoch 4/300
6/6 [==============================] - 0s 15ms/step - loss: 0.6181 - accuracy: 0.6919 - val_loss: 0.6131 - val_accuracy: 0.6797
Epoch 5/300
6/6 [==============================] - 0s 3ms/step - loss: 0.6077 - accuracy: 0.6945 - val_loss: 0.6037 - val_accuracy: 0.7031
Epoch 6/300
6/6 [==============================] - 0s 3ms/step - loss: 0.5975 - accuracy: 0.6971 - val_loss: 0.5945 - val_accuracy: 0.7188
Epoch 7/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5877 - accuracy: 0.7102 - val_loss: 0.5859 - val_accuracy: 0.7344
Epoch 8/300
6/6 [==============================] - 0s 2ms/step - loss: 0.5781 - accuracy: 0.7180 - val_loss: 0.5777 - val_accuracy: 0.7422
Epoch 9/300
6/6 [==============================] - 0s 15ms/step - loss: 0.5701 - accuracy: 0.7206 - val_loss: 0.5696 - val_accuracy: 0.7500
Epoch 10/300
6/6 [==============================] - 0s 2ms/step - loss: 0.5624 - accuracy: 0.7206 - val_loss: 0.5615 - val_accuracy: 0.7578
Epoch 11/300
6/6 [==============================] - 0s 3ms/step - loss: 0.5542 - accuracy: 0.7206 - val_loss: 0.5540 - val_accuracy: 0.7578
Epoch 12/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5473 - accuracy: 0.7180 - val_loss: 0.5470 - val_accuracy: 0.7578
Epoch 13/300
6/6 [==============================] - 0s 3ms/step - loss: 0.5405 - accuracy: 0.7232 - val_loss: 0.5403 - val_accuracy: 0.7578
Epoch 14/300
6/6 [==============================] - 0s 15ms/step - loss: 0.5346 - accuracy: 0.7258 - val_loss: 0.5337 - val_accuracy: 0.7578
Epoch 15/300
6/6 [==============================] - 0s 3ms/step - loss: 0.5280 - accuracy: 0.7389 - val_loss: 0.5279 - val_accuracy: 0.7578
Epoch 16/300
6/6 [==============================] - 0s 2ms/step - loss: 0.5224 - accuracy: 0.7441 - val_loss: 0.5223 - val_accuracy: 0.7578
Epoch 17/300
6/6 [==============================] - 0s 15ms/step - loss: 0.5168 - accuracy: 0.7572 - val_loss: 0.5171 - val_accuracy: 0.7578
Epoch 18/300
6/6 [==============================] - 0s 2ms/step - loss: 0.5119 - accuracy: 0.7624 - val_loss: 0.5118 - val_accuracy: 0.7734
Epoch 19/300
6/6 [==============================] - 0s 13ms/step - loss: 0.5070 - accuracy: 0.7572 - val_loss: 0.5067 - val_accuracy: 0.7734
Epoch 20/300
6/6 [==============================] - 0s 2ms/step - loss: 0.5024 - accuracy: 0.7624 - val_loss: 0.5018 - val_accuracy: 0.7734
Epoch 21/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4978 - accuracy: 0.7624 - val_loss: 0.4974 - val_accuracy: 0.7734
Epoch 22/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4940 - accuracy: 0.7702 - val_loss: 0.4929 - val_accuracy: 0.7734
Epoch 23/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4897 - accuracy: 0.7755 - val_loss: 0.4888 - val_accuracy: 0.7656
Epoch 24/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4862 - accuracy: 0.7755 - val_loss: 0.4849 - val_accuracy: 0.7656
Epoch 25/300
6/6 [==============================] - 0s 3ms/step - loss: 0.4825 - accuracy: 0.7833 - val_loss: 0.4814 - val_accuracy: 0.7578
Epoch 26/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4797 - accuracy: 0.7885 - val_loss: 0.4779 - val_accuracy: 0.7578
Epoch 27/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4766 - accuracy: 0.7885 - val_loss: 0.4747 - val_accuracy: 0.7344
Epoch 28/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4739 - accuracy: 0.7859 - val_loss: 0.4717 - val_accuracy: 0.7422
Epoch 29/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4711 - accuracy: 0.7859 - val_loss: 0.4688 - val_accuracy: 0.7422
Epoch 30/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4687 - accuracy: 0.7885 - val_loss: 0.4661 - val_accuracy: 0.7500
Epoch 31/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4664 - accuracy: 0.7885 - val_loss: 0.4632 - val_accuracy: 0.7578
Epoch 32/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4643 - accuracy: 0.7911 - val_loss: 0.4606 - val_accuracy: 0.7656
Epoch 33/300
6/6 [==============================] - 0s 3ms/step - loss: 0.4623 - accuracy: 0.7885 - val_loss: 0.4583 - val_accuracy: 0.7656
Epoch 34/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4604 - accuracy: 0.7859 - val_loss: 0.4559 - val_accuracy: 0.7656
Epoch 35/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4583 - accuracy: 0.7885 - val_loss: 0.4540 - val_accuracy: 0.7656
Epoch 36/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4565 - accuracy: 0.7885 - val_loss: 0.4523 - val_accuracy: 0.7656
Epoch 37/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4549 - accuracy: 0.7885 - val_loss: 0.4503 - val_accuracy: 0.7656
Epoch 38/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4530 - accuracy: 0.7911 - val_loss: 0.4485 - val_accuracy: 0.7734
Epoch 39/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4514 - accuracy: 0.7937 - val_loss: 0.4470 - val_accuracy: 0.7734
Epoch 40/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4501 - accuracy: 0.7937 - val_loss: 0.4454 - val_accuracy: 0.7734
Epoch 41/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4488 - accuracy: 0.7990 - val_loss: 0.4441 - val_accuracy: 0.7734
Epoch 42/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4474 - accuracy: 0.8016 - val_loss: 0.4425 - val_accuracy: 0.7734
Epoch 43/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4460 - accuracy: 0.8016 - val_loss: 0.4413 - val_accuracy: 0.7734
Epoch 44/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4447 - accuracy: 0.8016 - val_loss: 0.4401 - val_accuracy: 0.7812
Epoch 45/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4435 - accuracy: 0.8016 - val_loss: 0.4390 - val_accuracy: 0.7812
Epoch 46/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4424 - accuracy: 0.8016 - val_loss: 0.4379 - val_accuracy: 0.7812
Epoch 47/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4413 - accuracy: 0.8016 - val_loss: 0.4363 - val_accuracy: 0.7812
Epoch 48/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4403 - accuracy: 0.8016 - val_loss: 0.4353 - val_accuracy: 0.7812
Epoch 49/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4392 - accuracy: 0.8016 - val_loss: 0.4347 - val_accuracy: 0.7812
Epoch 50/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4382 - accuracy: 0.8016 - val_loss: 0.4338 - val_accuracy: 0.7812
Epoch 51/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4374 - accuracy: 0.8016 - val_loss: 0.4331 - val_accuracy: 0.7812
Epoch 52/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4362 - accuracy: 0.8016 - val_loss: 0.4327 - val_accuracy: 0.7812
Epoch 53/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4354 - accuracy: 0.8042 - val_loss: 0.4322 - val_accuracy: 0.7812
Epoch 54/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4346 - accuracy: 0.8068 - val_loss: 0.4318 - val_accuracy: 0.7734
Epoch 55/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4336 - accuracy: 0.8042 - val_loss: 0.4314 - val_accuracy: 0.7812
Epoch 56/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4327 - accuracy: 0.8068 - val_loss: 0.4310 - val_accuracy: 0.7812
Epoch 57/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4319 - accuracy: 0.8042 - val_loss: 0.4306 - val_accuracy: 0.7812
Epoch 58/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4311 - accuracy: 0.8042 - val_loss: 0.4305 - val_accuracy: 0.7812
Epoch 59/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4304 - accuracy: 0.8042 - val_loss: 0.4301 - val_accuracy: 0.7812
Epoch 60/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4294 - accuracy: 0.8068 - val_loss: 0.4302 - val_accuracy: 0.7812
Epoch 61/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4287 - accuracy: 0.8068 - val_loss: 0.4299 - val_accuracy: 0.7891
Epoch 62/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4278 - accuracy: 0.8068 - val_loss: 0.4300 - val_accuracy: 0.7891
Epoch 63/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4271 - accuracy: 0.8094 - val_loss: 0.4301 - val_accuracy: 0.7969
Epoch 64/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4264 - accuracy: 0.8094 - val_loss: 0.4301 - val_accuracy: 0.7891
Epoch 65/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4255 - accuracy: 0.8094 - val_loss: 0.4303 - val_accuracy: 0.7969
Epoch 66/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4250 - accuracy: 0.8094 - val_loss: 0.4305 - val_accuracy: 0.7891
Epoch 67/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4241 - accuracy: 0.8094 - val_loss: 0.4302 - val_accuracy: 0.8047
Epoch 68/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4234 - accuracy: 0.8068 - val_loss: 0.4306 - val_accuracy: 0.8047
Epoch 69/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4227 - accuracy: 0.8068 - val_loss: 0.4307 - val_accuracy: 0.8047
Epoch 70/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4220 - accuracy: 0.8068 - val_loss: 0.4312 - val_accuracy: 0.8047
Epoch 71/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4211 - accuracy: 0.8068 - val_loss: 0.4315 - val_accuracy: 0.8047
Epoch 72/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4206 - accuracy: 0.8094 - val_loss: 0.4322 - val_accuracy: 0.8047
Epoch 73/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4197 - accuracy: 0.8094 - val_loss: 0.4323 - val_accuracy: 0.8047
Epoch 74/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4190 - accuracy: 0.8094 - val_loss: 0.4329 - val_accuracy: 0.8047
Epoch 75/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4185 - accuracy: 0.8094 - val_loss: 0.4335 - val_accuracy: 0.8047
Epoch 76/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4179 - accuracy: 0.8094 - val_loss: 0.4339 - val_accuracy: 0.8047
Epoch 77/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4171 - accuracy: 0.8094 - val_loss: 0.4342 - val_accuracy: 0.7969
Epoch 78/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4165 - accuracy: 0.8094 - val_loss: 0.4348 - val_accuracy: 0.7969
Epoch 79/300
6/6 [==============================] - 0s 3ms/step - loss: 0.4158 - accuracy: 0.8094 - val_loss: 0.4353 - val_accuracy: 0.7891
Epoch 80/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4152 - accuracy: 0.8094 - val_loss: 0.4358 - val_accuracy: 0.7891
Epoch 81/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4147 - accuracy: 0.8094 - val_loss: 0.4364 - val_accuracy: 0.7891
Epoch 82/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4141 - accuracy: 0.8120 - val_loss: 0.4367 - val_accuracy: 0.7891
Epoch 83/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4136 - accuracy: 0.8120 - val_loss: 0.4374 - val_accuracy: 0.7812
Epoch 84/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4130 - accuracy: 0.8120 - val_loss: 0.4380 - val_accuracy: 0.7812
Epoch 85/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4123 - accuracy: 0.8120 - val_loss: 0.4384 - val_accuracy: 0.7812
Epoch 86/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4118 - accuracy: 0.8146 - val_loss: 0.4389 - val_accuracy: 0.7812
Epoch 87/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4111 - accuracy: 0.8120 - val_loss: 0.4393 - val_accuracy: 0.7812
Epoch 88/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4104 - accuracy: 0.8146 - val_loss: 0.4398 - val_accuracy: 0.7812
Epoch 89/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4099 - accuracy: 0.8120 - val_loss: 0.4406 - val_accuracy: 0.7812
Epoch 90/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4092 - accuracy: 0.8120 - val_loss: 0.4409 - val_accuracy: 0.7812
Epoch 91/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4088 - accuracy: 0.8146 - val_loss: 0.4414 - val_accuracy: 0.7812
Epoch 92/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4081 - accuracy: 0.8146 - val_loss: 0.4418 - val_accuracy: 0.7812
Epoch 93/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4079 - accuracy: 0.8120 - val_loss: 0.4427 - val_accuracy: 0.7812
Epoch 94/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4072 - accuracy: 0.8120 - val_loss: 0.4429 - val_accuracy: 0.7812
Epoch 95/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4067 - accuracy: 0.8120 - val_loss: 0.4433 - val_accuracy: 0.7812
Epoch 96/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4061 - accuracy: 0.8120 - val_loss: 0.4438 - val_accuracy: 0.7812
Epoch 97/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4057 - accuracy: 0.8120 - val_loss: 0.4445 - val_accuracy: 0.7812
Epoch 98/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4052 - accuracy: 0.8120 - val_loss: 0.4452 - val_accuracy: 0.7812
Epoch 99/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4047 - accuracy: 0.8120 - val_loss: 0.4457 - val_accuracy: 0.7812
Epoch 100/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4044 - accuracy: 0.8094 - val_loss: 0.4463 - val_accuracy: 0.7812
Epoch 101/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4039 - accuracy: 0.8146 - val_loss: 0.4468 - val_accuracy: 0.7812
Epoch 102/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4033 - accuracy: 0.8120 - val_loss: 0.4472 - val_accuracy: 0.7812
Epoch 103/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4030 - accuracy: 0.8120 - val_loss: 0.4476 - val_accuracy: 0.7812
Epoch 104/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4028 - accuracy: 0.8120 - val_loss: 0.4477 - val_accuracy: 0.7812
Epoch 105/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4023 - accuracy: 0.8120 - val_loss: 0.4483 - val_accuracy: 0.7812
Epoch 106/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4017 - accuracy: 0.8120 - val_loss: 0.4489 - val_accuracy: 0.7812
Epoch 107/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4014 - accuracy: 0.8094 - val_loss: 0.4493 - val_accuracy: 0.7812
Epoch 108/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4009 - accuracy: 0.8094 - val_loss: 0.4500 - val_accuracy: 0.7812
Epoch 109/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4004 - accuracy: 0.8094 - val_loss: 0.4504 - val_accuracy: 0.7812
Epoch 110/300
6/6 [==============================] - 0s 2ms/step - loss: 0.4000 - accuracy: 0.8094 - val_loss: 0.4509 - val_accuracy: 0.7812
Epoch 111/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3996 - accuracy: 0.8094 - val_loss: 0.4511 - val_accuracy: 0.7812
Epoch 112/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3993 - accuracy: 0.8094 - val_loss: 0.4514 - val_accuracy: 0.7812
Epoch 113/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3990 - accuracy: 0.8068 - val_loss: 0.4522 - val_accuracy: 0.7812
Epoch 114/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3986 - accuracy: 0.8068 - val_loss: 0.4524 - val_accuracy: 0.7812
Epoch 115/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3982 - accuracy: 0.8068 - val_loss: 0.4528 - val_accuracy: 0.7812
Epoch 116/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3979 - accuracy: 0.8068 - val_loss: 0.4532 - val_accuracy: 0.7812
Epoch 117/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3977 - accuracy: 0.8094 - val_loss: 0.4538 - val_accuracy: 0.7812
Epoch 118/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3970 - accuracy: 0.8094 - val_loss: 0.4542 - val_accuracy: 0.7812
Epoch 119/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3967 - accuracy: 0.8094 - val_loss: 0.4547 - val_accuracy: 0.7812
Epoch 120/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3962 - accuracy: 0.8120 - val_loss: 0.4547 - val_accuracy: 0.7812
Epoch 121/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3960 - accuracy: 0.8120 - val_loss: 0.4557 - val_accuracy: 0.7812
Epoch 122/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3956 - accuracy: 0.8120 - val_loss: 0.4561 - val_accuracy: 0.7812
Epoch 123/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3954 - accuracy: 0.8120 - val_loss: 0.4566 - val_accuracy: 0.7812
Epoch 124/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3948 - accuracy: 0.8120 - val_loss: 0.4574 - val_accuracy: 0.7812
Epoch 125/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3944 - accuracy: 0.8120 - val_loss: 0.4578 - val_accuracy: 0.7812
Epoch 126/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3943 - accuracy: 0.8120 - val_loss: 0.4587 - val_accuracy: 0.7812
Epoch 127/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3937 - accuracy: 0.8120 - val_loss: 0.4590 - val_accuracy: 0.7812
Epoch 128/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3933 - accuracy: 0.8120 - val_loss: 0.4590 - val_accuracy: 0.7812
Epoch 129/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3930 - accuracy: 0.8120 - val_loss: 0.4595 - val_accuracy: 0.7812
Epoch 130/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3927 - accuracy: 0.8120 - val_loss: 0.4597 - val_accuracy: 0.7812
Epoch 131/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3923 - accuracy: 0.8146 - val_loss: 0.4603 - val_accuracy: 0.7812
Epoch 132/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3918 - accuracy: 0.8146 - val_loss: 0.4606 - val_accuracy: 0.7812
Epoch 133/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3914 - accuracy: 0.8146 - val_loss: 0.4611 - val_accuracy: 0.7812
Epoch 134/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3912 - accuracy: 0.8172 - val_loss: 0.4615 - val_accuracy: 0.7812
Epoch 135/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3907 - accuracy: 0.8146 - val_loss: 0.4618 - val_accuracy: 0.7812
Epoch 136/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3904 - accuracy: 0.8146 - val_loss: 0.4622 - val_accuracy: 0.7812
Epoch 137/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3900 - accuracy: 0.8146 - val_loss: 0.4625 - val_accuracy: 0.7812
Epoch 138/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3897 - accuracy: 0.8146 - val_loss: 0.4632 - val_accuracy: 0.7812
Epoch 139/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3893 - accuracy: 0.8146 - val_loss: 0.4629 - val_accuracy: 0.7812
Epoch 140/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3890 - accuracy: 0.8146 - val_loss: 0.4632 - val_accuracy: 0.7812
Epoch 141/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3886 - accuracy: 0.8146 - val_loss: 0.4639 - val_accuracy: 0.7812
Epoch 142/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3883 - accuracy: 0.8146 - val_loss: 0.4643 - val_accuracy: 0.7812
Epoch 143/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3880 - accuracy: 0.8146 - val_loss: 0.4648 - val_accuracy: 0.7812
Epoch 144/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3876 - accuracy: 0.8172 - val_loss: 0.4647 - val_accuracy: 0.7812
Epoch 145/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3875 - accuracy: 0.8172 - val_loss: 0.4650 - val_accuracy: 0.7812
Epoch 146/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3870 - accuracy: 0.8172 - val_loss: 0.4648 - val_accuracy: 0.7812
Epoch 147/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3867 - accuracy: 0.8146 - val_loss: 0.4649 - val_accuracy: 0.7812
Epoch 148/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3864 - accuracy: 0.8146 - val_loss: 0.4655 - val_accuracy: 0.7812
Epoch 149/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3860 - accuracy: 0.8146 - val_loss: 0.4658 - val_accuracy: 0.7812
Epoch 150/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3856 - accuracy: 0.8146 - val_loss: 0.4660 - val_accuracy: 0.7812
Epoch 151/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3855 - accuracy: 0.8172 - val_loss: 0.4662 - val_accuracy: 0.7812
Epoch 152/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3852 - accuracy: 0.8172 - val_loss: 0.4666 - val_accuracy: 0.7734
Epoch 153/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3851 - accuracy: 0.8146 - val_loss: 0.4664 - val_accuracy: 0.7812
Epoch 154/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3846 - accuracy: 0.8172 - val_loss: 0.4667 - val_accuracy: 0.7812
Epoch 155/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3843 - accuracy: 0.8172 - val_loss: 0.4671 - val_accuracy: 0.7812
Epoch 156/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3842 - accuracy: 0.8172 - val_loss: 0.4674 - val_accuracy: 0.7812
Epoch 157/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3838 - accuracy: 0.8172 - val_loss: 0.4678 - val_accuracy: 0.7812
Epoch 158/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3836 - accuracy: 0.8172 - val_loss: 0.4679 - val_accuracy: 0.7734
Epoch 159/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3834 - accuracy: 0.8172 - val_loss: 0.4680 - val_accuracy: 0.7734
Epoch 160/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3830 - accuracy: 0.8172 - val_loss: 0.4679 - val_accuracy: 0.7734
Epoch 161/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3827 - accuracy: 0.8172 - val_loss: 0.4682 - val_accuracy: 0.7734
Epoch 162/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3826 - accuracy: 0.8172 - val_loss: 0.4681 - val_accuracy: 0.7734
Epoch 163/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3822 - accuracy: 0.8172 - val_loss: 0.4685 - val_accuracy: 0.7734
Epoch 164/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3821 - accuracy: 0.8172 - val_loss: 0.4684 - val_accuracy: 0.7734
Epoch 165/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3818 - accuracy: 0.8146 - val_loss: 0.4685 - val_accuracy: 0.7734
Epoch 166/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3816 - accuracy: 0.8120 - val_loss: 0.4690 - val_accuracy: 0.7734
Epoch 167/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3812 - accuracy: 0.8120 - val_loss: 0.4689 - val_accuracy: 0.7734
Epoch 168/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3813 - accuracy: 0.8120 - val_loss: 0.4691 - val_accuracy: 0.7734
Epoch 169/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3808 - accuracy: 0.8120 - val_loss: 0.4691 - val_accuracy: 0.7734
Epoch 170/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3806 - accuracy: 0.8120 - val_loss: 0.4690 - val_accuracy: 0.7734
Epoch 171/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3805 - accuracy: 0.8120 - val_loss: 0.4696 - val_accuracy: 0.7734
Epoch 172/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3802 - accuracy: 0.8120 - val_loss: 0.4700 - val_accuracy: 0.7656
Epoch 173/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3799 - accuracy: 0.8120 - val_loss: 0.4700 - val_accuracy: 0.7734
Epoch 174/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3798 - accuracy: 0.8120 - val_loss: 0.4696 - val_accuracy: 0.7734
Epoch 175/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3796 - accuracy: 0.8120 - val_loss: 0.4699 - val_accuracy: 0.7734
Epoch 176/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3792 - accuracy: 0.8120 - val_loss: 0.4698 - val_accuracy: 0.7734
Epoch 177/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3790 - accuracy: 0.8120 - val_loss: 0.4700 - val_accuracy: 0.7734
Epoch 178/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3788 - accuracy: 0.8120 - val_loss: 0.4698 - val_accuracy: 0.7734
Epoch 179/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3788 - accuracy: 0.8120 - val_loss: 0.4702 - val_accuracy: 0.7734
Epoch 180/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3785 - accuracy: 0.8120 - val_loss: 0.4704 - val_accuracy: 0.7734
Epoch 181/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3782 - accuracy: 0.8120 - val_loss: 0.4705 - val_accuracy: 0.7734
Epoch 182/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3779 - accuracy: 0.8120 - val_loss: 0.4708 - val_accuracy: 0.7734
Epoch 183/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3777 - accuracy: 0.8120 - val_loss: 0.4712 - val_accuracy: 0.7734
Epoch 184/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3774 - accuracy: 0.8120 - val_loss: 0.4712 - val_accuracy: 0.7734
Epoch 185/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3773 - accuracy: 0.8120 - val_loss: 0.4713 - val_accuracy: 0.7812
Epoch 186/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3773 - accuracy: 0.8120 - val_loss: 0.4715 - val_accuracy: 0.7812
Epoch 187/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3769 - accuracy: 0.8172 - val_loss: 0.4716 - val_accuracy: 0.7812
Epoch 188/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3767 - accuracy: 0.8146 - val_loss: 0.4716 - val_accuracy: 0.7812
Epoch 189/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3765 - accuracy: 0.8094 - val_loss: 0.4722 - val_accuracy: 0.7812
Epoch 190/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3762 - accuracy: 0.8068 - val_loss: 0.4726 - val_accuracy: 0.7812
Epoch 191/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3761 - accuracy: 0.8094 - val_loss: 0.4726 - val_accuracy: 0.7812
Epoch 192/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3757 - accuracy: 0.8068 - val_loss: 0.4728 - val_accuracy: 0.7812
Epoch 193/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3756 - accuracy: 0.8094 - val_loss: 0.4732 - val_accuracy: 0.7812
Epoch 194/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3753 - accuracy: 0.8094 - val_loss: 0.4732 - val_accuracy: 0.7812
Epoch 195/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3751 - accuracy: 0.8094 - val_loss: 0.4732 - val_accuracy: 0.7812
Epoch 196/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3749 - accuracy: 0.8068 - val_loss: 0.4732 - val_accuracy: 0.7812
Epoch 197/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3745 - accuracy: 0.8120 - val_loss: 0.4732 - val_accuracy: 0.7812
Epoch 198/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3744 - accuracy: 0.8146 - val_loss: 0.4731 - val_accuracy: 0.7812
Epoch 199/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3741 - accuracy: 0.8120 - val_loss: 0.4733 - val_accuracy: 0.7812
Epoch 200/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3739 - accuracy: 0.8094 - val_loss: 0.4738 - val_accuracy: 0.7734
Epoch 201/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3738 - accuracy: 0.8120 - val_loss: 0.4743 - val_accuracy: 0.7734
Epoch 202/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3735 - accuracy: 0.8120 - val_loss: 0.4742 - val_accuracy: 0.7734
Epoch 203/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3733 - accuracy: 0.8120 - val_loss: 0.4740 - val_accuracy: 0.7734
Epoch 204/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3731 - accuracy: 0.8094 - val_loss: 0.4741 - val_accuracy: 0.7812
Epoch 205/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3730 - accuracy: 0.8094 - val_loss: 0.4744 - val_accuracy: 0.7891
Epoch 206/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3729 - accuracy: 0.8120 - val_loss: 0.4745 - val_accuracy: 0.7812
Epoch 207/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3725 - accuracy: 0.8120 - val_loss: 0.4751 - val_accuracy: 0.7734
Epoch 208/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3724 - accuracy: 0.8120 - val_loss: 0.4747 - val_accuracy: 0.7812
Epoch 209/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3722 - accuracy: 0.8120 - val_loss: 0.4748 - val_accuracy: 0.7891
Epoch 210/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3723 - accuracy: 0.8120 - val_loss: 0.4754 - val_accuracy: 0.7812
Epoch 211/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3717 - accuracy: 0.8120 - val_loss: 0.4754 - val_accuracy: 0.7812
Epoch 212/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3717 - accuracy: 0.8094 - val_loss: 0.4757 - val_accuracy: 0.7812
Epoch 213/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3715 - accuracy: 0.8068 - val_loss: 0.4756 - val_accuracy: 0.7891
Epoch 214/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3713 - accuracy: 0.8094 - val_loss: 0.4758 - val_accuracy: 0.7812
Epoch 215/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3710 - accuracy: 0.8094 - val_loss: 0.4761 - val_accuracy: 0.7812
Epoch 216/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3711 - accuracy: 0.8094 - val_loss: 0.4756 - val_accuracy: 0.7891
Epoch 217/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3705 - accuracy: 0.8094 - val_loss: 0.4764 - val_accuracy: 0.7891
Epoch 218/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3703 - accuracy: 0.8094 - val_loss: 0.4768 - val_accuracy: 0.7891
Epoch 219/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3702 - accuracy: 0.8120 - val_loss: 0.4767 - val_accuracy: 0.7891
Epoch 220/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3700 - accuracy: 0.8120 - val_loss: 0.4771 - val_accuracy: 0.7891
Epoch 221/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3696 - accuracy: 0.8120 - val_loss: 0.4772 - val_accuracy: 0.7891
Epoch 222/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3695 - accuracy: 0.8120 - val_loss: 0.4775 - val_accuracy: 0.7891
Epoch 223/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3694 - accuracy: 0.8120 - val_loss: 0.4779 - val_accuracy: 0.7891
Epoch 224/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3690 - accuracy: 0.8120 - val_loss: 0.4779 - val_accuracy: 0.7891
Epoch 225/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3690 - accuracy: 0.8120 - val_loss: 0.4779 - val_accuracy: 0.7891
Epoch 226/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3687 - accuracy: 0.8120 - val_loss: 0.4781 - val_accuracy: 0.7891
Epoch 227/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3685 - accuracy: 0.8120 - val_loss: 0.4777 - val_accuracy: 0.7891
Epoch 228/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3684 - accuracy: 0.8120 - val_loss: 0.4780 - val_accuracy: 0.7891
Epoch 229/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3681 - accuracy: 0.8120 - val_loss: 0.4782 - val_accuracy: 0.7891
Epoch 230/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3680 - accuracy: 0.8146 - val_loss: 0.4786 - val_accuracy: 0.7891
Epoch 231/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3677 - accuracy: 0.8146 - val_loss: 0.4788 - val_accuracy: 0.7891
Epoch 232/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3676 - accuracy: 0.8120 - val_loss: 0.4785 - val_accuracy: 0.7891
Epoch 233/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3675 - accuracy: 0.8120 - val_loss: 0.4783 - val_accuracy: 0.7891
Epoch 234/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3672 - accuracy: 0.8120 - val_loss: 0.4786 - val_accuracy: 0.7891
Epoch 235/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3672 - accuracy: 0.8146 - val_loss: 0.4790 - val_accuracy: 0.7891
Epoch 236/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3669 - accuracy: 0.8198 - val_loss: 0.4787 - val_accuracy: 0.7891
Epoch 237/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3667 - accuracy: 0.8198 - val_loss: 0.4788 - val_accuracy: 0.7891
Epoch 238/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3665 - accuracy: 0.8172 - val_loss: 0.4783 - val_accuracy: 0.7891
Epoch 239/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3664 - accuracy: 0.8198 - val_loss: 0.4786 - val_accuracy: 0.7891
Epoch 240/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3664 - accuracy: 0.8172 - val_loss: 0.4791 - val_accuracy: 0.7891
Epoch 241/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3660 - accuracy: 0.8172 - val_loss: 0.4783 - val_accuracy: 0.7891
Epoch 242/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3658 - accuracy: 0.8172 - val_loss: 0.4786 - val_accuracy: 0.7891
Epoch 243/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3656 - accuracy: 0.8198 - val_loss: 0.4789 - val_accuracy: 0.7891
Epoch 244/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3654 - accuracy: 0.8198 - val_loss: 0.4793 - val_accuracy: 0.7891
Epoch 245/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3653 - accuracy: 0.8225 - val_loss: 0.4790 - val_accuracy: 0.7891
Epoch 246/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3651 - accuracy: 0.8225 - val_loss: 0.4785 - val_accuracy: 0.7891
Epoch 247/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3647 - accuracy: 0.8225 - val_loss: 0.4792 - val_accuracy: 0.7891
Epoch 248/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3647 - accuracy: 0.8225 - val_loss: 0.4794 - val_accuracy: 0.7891
Epoch 249/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3645 - accuracy: 0.8225 - val_loss: 0.4796 - val_accuracy: 0.7891
Epoch 250/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3644 - accuracy: 0.8225 - val_loss: 0.4805 - val_accuracy: 0.7891
Epoch 251/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3641 - accuracy: 0.8225 - val_loss: 0.4804 - val_accuracy: 0.7891
Epoch 252/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3640 - accuracy: 0.8225 - val_loss: 0.4802 - val_accuracy: 0.7891
Epoch 253/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3637 - accuracy: 0.8225 - val_loss: 0.4806 - val_accuracy: 0.7891
Epoch 254/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3635 - accuracy: 0.8198 - val_loss: 0.4811 - val_accuracy: 0.7891
Epoch 255/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3634 - accuracy: 0.8198 - val_loss: 0.4814 - val_accuracy: 0.7891
Epoch 256/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3632 - accuracy: 0.8198 - val_loss: 0.4814 - val_accuracy: 0.7891
Epoch 257/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3630 - accuracy: 0.8198 - val_loss: 0.4820 - val_accuracy: 0.7891
Epoch 258/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3631 - accuracy: 0.8198 - val_loss: 0.4813 - val_accuracy: 0.7891
Epoch 259/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3627 - accuracy: 0.8198 - val_loss: 0.4823 - val_accuracy: 0.7891
Epoch 260/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3626 - accuracy: 0.8198 - val_loss: 0.4828 - val_accuracy: 0.7891
Epoch 261/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3625 - accuracy: 0.8198 - val_loss: 0.4824 - val_accuracy: 0.7891
Epoch 262/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3623 - accuracy: 0.8198 - val_loss: 0.4828 - val_accuracy: 0.7891
Epoch 263/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3620 - accuracy: 0.8198 - val_loss: 0.4833 - val_accuracy: 0.7891
Epoch 264/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3618 - accuracy: 0.8198 - val_loss: 0.4839 - val_accuracy: 0.7891
Epoch 265/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3618 - accuracy: 0.8198 - val_loss: 0.4846 - val_accuracy: 0.7891
Epoch 266/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3616 - accuracy: 0.8198 - val_loss: 0.4840 - val_accuracy: 0.7891
Epoch 267/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3614 - accuracy: 0.8198 - val_loss: 0.4844 - val_accuracy: 0.7891
Epoch 268/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3614 - accuracy: 0.8198 - val_loss: 0.4853 - val_accuracy: 0.7891
Epoch 269/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3611 - accuracy: 0.8198 - val_loss: 0.4856 - val_accuracy: 0.7891
Epoch 270/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3608 - accuracy: 0.8198 - val_loss: 0.4850 - val_accuracy: 0.7891
Epoch 271/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3610 - accuracy: 0.8198 - val_loss: 0.4845 - val_accuracy: 0.7891
Epoch 272/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3607 - accuracy: 0.8198 - val_loss: 0.4855 - val_accuracy: 0.7891
Epoch 273/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3606 - accuracy: 0.8198 - val_loss: 0.4856 - val_accuracy: 0.7891
Epoch 274/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3604 - accuracy: 0.8198 - val_loss: 0.4858 - val_accuracy: 0.7891
Epoch 275/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3602 - accuracy: 0.8198 - val_loss: 0.4856 - val_accuracy: 0.7891
Epoch 276/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3603 - accuracy: 0.8198 - val_loss: 0.4853 - val_accuracy: 0.7891
Epoch 277/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3600 - accuracy: 0.8198 - val_loss: 0.4859 - val_accuracy: 0.7891
Epoch 278/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3599 - accuracy: 0.8198 - val_loss: 0.4855 - val_accuracy: 0.7891
Epoch 279/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3597 - accuracy: 0.8198 - val_loss: 0.4861 - val_accuracy: 0.7891
Epoch 280/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3595 - accuracy: 0.8198 - val_loss: 0.4863 - val_accuracy: 0.7891
Epoch 281/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3598 - accuracy: 0.8198 - val_loss: 0.4860 - val_accuracy: 0.7891
Epoch 282/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3592 - accuracy: 0.8198 - val_loss: 0.4860 - val_accuracy: 0.7891
Epoch 283/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3590 - accuracy: 0.8198 - val_loss: 0.4863 - val_accuracy: 0.7891
Epoch 284/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3590 - accuracy: 0.8198 - val_loss: 0.4875 - val_accuracy: 0.7891
Epoch 285/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3588 - accuracy: 0.8198 - val_loss: 0.4866 - val_accuracy: 0.7891
Epoch 286/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3586 - accuracy: 0.8198 - val_loss: 0.4871 - val_accuracy: 0.7891
Epoch 287/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3585 - accuracy: 0.8198 - val_loss: 0.4881 - val_accuracy: 0.7891
Epoch 288/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3583 - accuracy: 0.8198 - val_loss: 0.4874 - val_accuracy: 0.7891
Epoch 289/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3581 - accuracy: 0.8198 - val_loss: 0.4869 - val_accuracy: 0.7891
Epoch 290/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3579 - accuracy: 0.8198 - val_loss: 0.4867 - val_accuracy: 0.7891
Epoch 291/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3577 - accuracy: 0.8198 - val_loss: 0.4877 - val_accuracy: 0.7891
Epoch 292/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3577 - accuracy: 0.8198 - val_loss: 0.4878 - val_accuracy: 0.7891
Epoch 293/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3573 - accuracy: 0.8198 - val_loss: 0.4874 - val_accuracy: 0.7891
Epoch 294/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3573 - accuracy: 0.8198 - val_loss: 0.4877 - val_accuracy: 0.7891
Epoch 295/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3570 - accuracy: 0.8198 - val_loss: 0.4878 - val_accuracy: 0.7891
Epoch 296/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3568 - accuracy: 0.8198 - val_loss: 0.4880 - val_accuracy: 0.7891
Epoch 297/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3566 - accuracy: 0.8198 - val_loss: 0.4882 - val_accuracy: 0.7891
Epoch 298/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3565 - accuracy: 0.8198 - val_loss: 0.4881 - val_accuracy: 0.7891
Epoch 299/300
6/6 [==============================] - 0s 2ms/step - loss: 0.3564 - accuracy: 0.8198 - val_loss: 0.4887 - val_accuracy: 0.7891
Epoch 300/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3562 - accuracy: 0.8198 - val_loss: 0.4892 - val_accuracy: 0.7891
WARNING:tensorflow:From /opt/conda/lib/python3.7/site-packages/tensorflow/python/keras/wrappers/scikit_learn.py:241: Sequential.predict_classes (from tensorflow.python.keras.engine.sequential) is deprecated and will be removed after 2021-01-01.
Instructions for updating:
Please use instead:* `np.argmax(model.predict(x), axis=-1)`,   if your model does multi-class classification   (e.g. if it uses a `softmax` last-layer activation).* `(model.predict(x) > 0.5).astype("int32")`,   if your model does binary classification   (e.g. if it uses a `sigmoid` last-layer activation).
In [31]:
# Print results for both training and validation sets for the overfit model
print("----------------------------")
print("Training accuracy: {:.2f}%".format(overfit_train_accuracy * 100))
print("Validation accuracy: {:.2f}%".format(overfit_val_accuracy * 100))
print("----------------------------")
print("Training F1 score: {:.2f}".format(overfit_f1_train))
print("Validation F1 score: {:.2f}".format(overfit_f1_val))
print("----------------------------")
print("Training precision: {:.2f}".format(overfit_precision_train))
print("Validation precision: {:.2f}".format(overfit_precision_val))
print("----------------------------")
print("Training recall: {:.2f}".format(overfit_recall_train))
print("Validation recall: {:.2f}".format(overfit_recall_val))
print("----------------------------")
----------------------------
Training accuracy: 81.98%
Validation accuracy: 78.91%
----------------------------
Training F1 score: 0.70
Validation F1 score: 0.65
----------------------------
Training precision: 0.76
Validation precision: 0.69
----------------------------
Training recall: 0.66
Validation recall: 0.61
----------------------------
In [32]:
# plotting the training and validation loss over each epoch
plt.plot(overfit_history.history['loss'])
plt.plot(overfit_history.history['val_loss'])
plt.title('Training and Validation Loss')
plt.xlabel('Epochs')
plt.ylabel('Loss')
plt.legend(['training', 'validation'],
           loc = 'upper right')
plt.show()

# plotting the training and validation accuracy over each epoch
plt.plot(overfit_history.history['accuracy'])
plt.plot(overfit_history.history['val_accuracy'])
plt.title('Training and Validation Accuracy')
plt.xlabel('Epochs')
plt.ylabel('Accuracy')
plt.legend(['training', 'validation'],
           loc = 'lower right')
plt.show()

We can clearly visualize from the graphs above that the model is overfitting. We can further confirm that the model is overfitting by comparing the accuracy scores above for training(83.72) and validation(77.98) sets as there is a pretty big difference in their accuracies.

Model Summary:

  • Hypothesis: To understand how big a model is to be able to find the model that lies between an overfit and underfit model.
  • No. of Hidden Layers: 1 - Added a hidden layer to increase model complexity which could lead to possible overfitting.
  • No. of Neurons For input and Hidden layers: 8 - Having 8 features with 682 features, the complexity of the model should be enough to overfit.
  • Optimizer: Adam
  • Learning Rate: 0.0015 - Increasing the learning rate so that the model learns faster and overfits
  • Loss Function: Binary Cross Entropy - Because its a binary classification
  • Batch Size: 64
  • No. of Epochs: 100
  • Accuracy: The accuracy of the overfit model is 82.9% on the Training Set
  • F1 Score:The F1 score is 70% on the Training set. I used F1 score as there is an imabalanced distribution of classes.
  • Precision: The precision of the model on the Training set is 76%
  • Recall: The model can recall upto 66% on the Training set

Regularizing the model and tuning the hyperparameters

In [33]:
# performing k-fold cross-validation on the training set
folds = 10
k_fold_state = 33
kfold = KFold(n_splits = folds,
              shuffle = True,
              random_state = k_fold_state)
scoring_metrics = ['accuracy', 'f1_macro', 'precision_macro', 'recall_macro']
scores = cross_validate(estimator = overfit_build,
                             X = X_train_scaled,
                             y = y_train,
                             cv = kfold,
                             scoring=scoring_metrics,
                             return_train_score=True)
Epoch 1/300
6/6 [==============================] - 0s 679us/step - loss: 0.6616 - accuracy: 0.6453
Epoch 2/300
6/6 [==============================] - 0s 13ms/step - loss: 0.6487 - accuracy: 0.6512
Epoch 3/300
6/6 [==============================] - 0s 572us/step - loss: 0.6365 - accuracy: 0.6686
Epoch 4/300
6/6 [==============================] - 0s 564us/step - loss: 0.6247 - accuracy: 0.6686
Epoch 5/300
6/6 [==============================] - 0s 14ms/step - loss: 0.6139 - accuracy: 0.6744
Epoch 6/300
6/6 [==============================] - 0s 588us/step - loss: 0.6040 - accuracy: 0.6773
Epoch 7/300
6/6 [==============================] - 0s 597us/step - loss: 0.5940 - accuracy: 0.6919
Epoch 8/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5848 - accuracy: 0.6977
Epoch 9/300
6/6 [==============================] - 0s 574us/step - loss: 0.5764 - accuracy: 0.7064
Epoch 10/300
6/6 [==============================] - 0s 607us/step - loss: 0.5685 - accuracy: 0.7035
Epoch 11/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5614 - accuracy: 0.7006
Epoch 12/300
6/6 [==============================] - 0s 644us/step - loss: 0.5543 - accuracy: 0.7064
Epoch 13/300
6/6 [==============================] - 0s 651us/step - loss: 0.5475 - accuracy: 0.7064
Epoch 14/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5421 - accuracy: 0.7122
Epoch 15/300
6/6 [==============================] - 0s 588us/step - loss: 0.5359 - accuracy: 0.7238
Epoch 16/300
6/6 [==============================] - 0s 607us/step - loss: 0.5301 - accuracy: 0.7267
Epoch 17/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5251 - accuracy: 0.7413
Epoch 18/300
6/6 [==============================] - 0s 587us/step - loss: 0.5194 - accuracy: 0.7471
Epoch 19/300
6/6 [==============================] - 0s 556us/step - loss: 0.5148 - accuracy: 0.7471
Epoch 20/300
6/6 [==============================] - 0s 564us/step - loss: 0.5102 - accuracy: 0.7471
Epoch 21/300
6/6 [==============================] - 0s 601us/step - loss: 0.5057 - accuracy: 0.7587
Epoch 22/300
6/6 [==============================] - 0s 575us/step - loss: 0.5014 - accuracy: 0.7674
Epoch 23/300
6/6 [==============================] - 0s 561us/step - loss: 0.4976 - accuracy: 0.7703
Epoch 24/300
6/6 [==============================] - 0s 609us/step - loss: 0.4940 - accuracy: 0.7733
Epoch 25/300
6/6 [==============================] - 0s 593us/step - loss: 0.4908 - accuracy: 0.7762
Epoch 26/300
6/6 [==============================] - 0s 589us/step - loss: 0.4879 - accuracy: 0.7791
Epoch 27/300
6/6 [==============================] - 0s 569us/step - loss: 0.4852 - accuracy: 0.7820
Epoch 28/300
6/6 [==============================] - 0s 555us/step - loss: 0.4825 - accuracy: 0.7849
Epoch 29/300
6/6 [==============================] - 0s 589us/step - loss: 0.4808 - accuracy: 0.7791
Epoch 30/300
6/6 [==============================] - 0s 580us/step - loss: 0.4783 - accuracy: 0.7762
Epoch 31/300
6/6 [==============================] - 0s 594us/step - loss: 0.4767 - accuracy: 0.7762
Epoch 32/300
6/6 [==============================] - 0s 580us/step - loss: 0.4745 - accuracy: 0.7762
Epoch 33/300
6/6 [==============================] - 0s 610us/step - loss: 0.4726 - accuracy: 0.7791
Epoch 34/300
6/6 [==============================] - 0s 600us/step - loss: 0.4708 - accuracy: 0.7791
Epoch 35/300
6/6 [==============================] - 0s 580us/step - loss: 0.4692 - accuracy: 0.7791
Epoch 36/300
6/6 [==============================] - 0s 560us/step - loss: 0.4677 - accuracy: 0.7791
Epoch 37/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4659 - accuracy: 0.7791
Epoch 38/300
6/6 [==============================] - 0s 590us/step - loss: 0.4646 - accuracy: 0.7762
Epoch 39/300
6/6 [==============================] - 0s 814us/step - loss: 0.4629 - accuracy: 0.7820
Epoch 40/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4617 - accuracy: 0.7849
Epoch 41/300
6/6 [==============================] - 0s 604us/step - loss: 0.4603 - accuracy: 0.7878
Epoch 42/300
6/6 [==============================] - 0s 610us/step - loss: 0.4591 - accuracy: 0.7878
Epoch 43/300
6/6 [==============================] - 0s 580us/step - loss: 0.4578 - accuracy: 0.7849
Epoch 44/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4567 - accuracy: 0.7878
Epoch 45/300
6/6 [==============================] - 0s 593us/step - loss: 0.4557 - accuracy: 0.7907
Epoch 46/300
6/6 [==============================] - 0s 636us/step - loss: 0.4547 - accuracy: 0.7907
Epoch 47/300
6/6 [==============================] - 0s 561us/step - loss: 0.4539 - accuracy: 0.7907
Epoch 48/300
6/6 [==============================] - 0s 553us/step - loss: 0.4529 - accuracy: 0.7907
Epoch 49/300
6/6 [==============================] - 0s 619us/step - loss: 0.4521 - accuracy: 0.7878
Epoch 50/300
6/6 [==============================] - 0s 570us/step - loss: 0.4512 - accuracy: 0.7878
Epoch 51/300
6/6 [==============================] - 0s 558us/step - loss: 0.4504 - accuracy: 0.7907
Epoch 52/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4495 - accuracy: 0.7936
Epoch 53/300
6/6 [==============================] - 0s 592us/step - loss: 0.4488 - accuracy: 0.7936
Epoch 54/300
6/6 [==============================] - 0s 573us/step - loss: 0.4480 - accuracy: 0.7907
Epoch 55/300
6/6 [==============================] - 0s 610us/step - loss: 0.4473 - accuracy: 0.7907
Epoch 56/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4467 - accuracy: 0.7907
Epoch 57/300
6/6 [==============================] - 0s 581us/step - loss: 0.4458 - accuracy: 0.7907
Epoch 58/300
6/6 [==============================] - 0s 622us/step - loss: 0.4451 - accuracy: 0.7907
Epoch 59/300
6/6 [==============================] - 0s 609us/step - loss: 0.4448 - accuracy: 0.7907
Epoch 60/300
6/6 [==============================] - 0s 618us/step - loss: 0.4439 - accuracy: 0.7907
Epoch 61/300
6/6 [==============================] - 0s 606us/step - loss: 0.4434 - accuracy: 0.7878
Epoch 62/300
6/6 [==============================] - 0s 588us/step - loss: 0.4428 - accuracy: 0.7878
Epoch 63/300
6/6 [==============================] - 0s 602us/step - loss: 0.4421 - accuracy: 0.7907
Epoch 64/300
6/6 [==============================] - 0s 604us/step - loss: 0.4416 - accuracy: 0.7907
Epoch 65/300
6/6 [==============================] - 0s 584us/step - loss: 0.4408 - accuracy: 0.7936
Epoch 66/300
6/6 [==============================] - 0s 589us/step - loss: 0.4403 - accuracy: 0.7936
Epoch 67/300
6/6 [==============================] - 0s 577us/step - loss: 0.4398 - accuracy: 0.7936
Epoch 68/300
6/6 [==============================] - 0s 564us/step - loss: 0.4392 - accuracy: 0.7878
Epoch 69/300
6/6 [==============================] - 0s 574us/step - loss: 0.4386 - accuracy: 0.7878
Epoch 70/300
6/6 [==============================] - 0s 588us/step - loss: 0.4380 - accuracy: 0.7907
Epoch 71/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4374 - accuracy: 0.7907
Epoch 72/300
6/6 [==============================] - 0s 610us/step - loss: 0.4369 - accuracy: 0.7907
Epoch 73/300
6/6 [==============================] - 0s 570us/step - loss: 0.4364 - accuracy: 0.7907
Epoch 74/300
6/6 [==============================] - 0s 582us/step - loss: 0.4359 - accuracy: 0.7907
Epoch 75/300
6/6 [==============================] - 0s 582us/step - loss: 0.4355 - accuracy: 0.7907
Epoch 76/300
6/6 [==============================] - 0s 607us/step - loss: 0.4348 - accuracy: 0.7907
Epoch 77/300
6/6 [==============================] - 0s 627us/step - loss: 0.4343 - accuracy: 0.7907
Epoch 78/300
6/6 [==============================] - 0s 583us/step - loss: 0.4339 - accuracy: 0.7907
Epoch 79/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4334 - accuracy: 0.7907
Epoch 80/300
6/6 [==============================] - 0s 574us/step - loss: 0.4330 - accuracy: 0.7907
Epoch 81/300
6/6 [==============================] - 0s 575us/step - loss: 0.4327 - accuracy: 0.7907
Epoch 82/300
6/6 [==============================] - 0s 577us/step - loss: 0.4323 - accuracy: 0.7907
Epoch 83/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4317 - accuracy: 0.7965
Epoch 84/300
6/6 [==============================] - 0s 578us/step - loss: 0.4313 - accuracy: 0.7965
Epoch 85/300
6/6 [==============================] - 0s 601us/step - loss: 0.4309 - accuracy: 0.7936
Epoch 86/300
6/6 [==============================] - 0s 592us/step - loss: 0.4305 - accuracy: 0.7965
Epoch 87/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4302 - accuracy: 0.7936
Epoch 88/300
6/6 [==============================] - 0s 576us/step - loss: 0.4298 - accuracy: 0.7965
Epoch 89/300
6/6 [==============================] - 0s 562us/step - loss: 0.4295 - accuracy: 0.7936
Epoch 90/300
6/6 [==============================] - 0s 590us/step - loss: 0.4290 - accuracy: 0.7936
Epoch 91/300
6/6 [==============================] - 0s 591us/step - loss: 0.4286 - accuracy: 0.7936
Epoch 92/300
6/6 [==============================] - 0s 593us/step - loss: 0.4283 - accuracy: 0.7965
Epoch 93/300
6/6 [==============================] - 0s 575us/step - loss: 0.4281 - accuracy: 0.7965
Epoch 94/300
6/6 [==============================] - 0s 571us/step - loss: 0.4276 - accuracy: 0.7965
Epoch 95/300
6/6 [==============================] - 0s 572us/step - loss: 0.4276 - accuracy: 0.7965
Epoch 96/300
6/6 [==============================] - 0s 583us/step - loss: 0.4272 - accuracy: 0.7965
Epoch 97/300
6/6 [==============================] - 0s 584us/step - loss: 0.4268 - accuracy: 0.7965
Epoch 98/300
6/6 [==============================] - 0s 561us/step - loss: 0.4265 - accuracy: 0.7965
Epoch 99/300
6/6 [==============================] - 0s 630us/step - loss: 0.4261 - accuracy: 0.7965
Epoch 100/300
6/6 [==============================] - 0s 592us/step - loss: 0.4259 - accuracy: 0.7907
Epoch 101/300
6/6 [==============================] - 0s 564us/step - loss: 0.4258 - accuracy: 0.7936
Epoch 102/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4253 - accuracy: 0.7936
Epoch 103/300
6/6 [==============================] - 0s 592us/step - loss: 0.4251 - accuracy: 0.7936
Epoch 104/300
6/6 [==============================] - 0s 579us/step - loss: 0.4247 - accuracy: 0.7936
Epoch 105/300
6/6 [==============================] - 0s 556us/step - loss: 0.4245 - accuracy: 0.7965
Epoch 106/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4242 - accuracy: 0.7965
Epoch 107/300
6/6 [==============================] - 0s 590us/step - loss: 0.4238 - accuracy: 0.7965
Epoch 108/300
6/6 [==============================] - 0s 570us/step - loss: 0.4238 - accuracy: 0.7965
Epoch 109/300
6/6 [==============================] - 0s 597us/step - loss: 0.4239 - accuracy: 0.7965
Epoch 110/300
6/6 [==============================] - 0s 568us/step - loss: 0.4230 - accuracy: 0.7965
Epoch 111/300
6/6 [==============================] - 0s 571us/step - loss: 0.4229 - accuracy: 0.7965
Epoch 112/300
6/6 [==============================] - 0s 563us/step - loss: 0.4227 - accuracy: 0.7994
Epoch 113/300
6/6 [==============================] - 0s 580us/step - loss: 0.4223 - accuracy: 0.7994
Epoch 114/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4221 - accuracy: 0.7994
Epoch 115/300
6/6 [==============================] - 0s 557us/step - loss: 0.4218 - accuracy: 0.7994
Epoch 116/300
6/6 [==============================] - 0s 554us/step - loss: 0.4215 - accuracy: 0.7994
Epoch 117/300
6/6 [==============================] - 0s 581us/step - loss: 0.4213 - accuracy: 0.7965
Epoch 118/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4209 - accuracy: 0.7965
Epoch 119/300
6/6 [==============================] - 0s 574us/step - loss: 0.4206 - accuracy: 0.7965
Epoch 120/300
6/6 [==============================] - 0s 553us/step - loss: 0.4204 - accuracy: 0.7965
Epoch 121/300
6/6 [==============================] - 0s 555us/step - loss: 0.4199 - accuracy: 0.7965
Epoch 122/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4196 - accuracy: 0.7965
Epoch 123/300
6/6 [==============================] - 0s 565us/step - loss: 0.4193 - accuracy: 0.7936
Epoch 124/300
6/6 [==============================] - 0s 532us/step - loss: 0.4190 - accuracy: 0.7965
Epoch 125/300
6/6 [==============================] - 0s 553us/step - loss: 0.4186 - accuracy: 0.7965
Epoch 126/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4183 - accuracy: 0.7965
Epoch 127/300
6/6 [==============================] - 0s 584us/step - loss: 0.4179 - accuracy: 0.7965
Epoch 128/300
6/6 [==============================] - 0s 554us/step - loss: 0.4175 - accuracy: 0.7965
Epoch 129/300
6/6 [==============================] - 0s 551us/step - loss: 0.4170 - accuracy: 0.7994
Epoch 130/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4167 - accuracy: 0.7965
Epoch 131/300
6/6 [==============================] - 0s 554us/step - loss: 0.4163 - accuracy: 0.7994
Epoch 132/300
6/6 [==============================] - 0s 539us/step - loss: 0.4158 - accuracy: 0.7994
Epoch 133/300
6/6 [==============================] - 0s 553us/step - loss: 0.4154 - accuracy: 0.7994
Epoch 134/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4150 - accuracy: 0.7994
Epoch 135/300
6/6 [==============================] - 0s 576us/step - loss: 0.4145 - accuracy: 0.7994
Epoch 136/300
6/6 [==============================] - 0s 538us/step - loss: 0.4142 - accuracy: 0.7994
Epoch 137/300
6/6 [==============================] - 0s 523us/step - loss: 0.4138 - accuracy: 0.7994
Epoch 138/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4134 - accuracy: 0.7994
Epoch 139/300
6/6 [==============================] - 0s 580us/step - loss: 0.4129 - accuracy: 0.8023
Epoch 140/300
6/6 [==============================] - 0s 543us/step - loss: 0.4125 - accuracy: 0.8023
Epoch 141/300
6/6 [==============================] - 0s 562us/step - loss: 0.4120 - accuracy: 0.8023
Epoch 142/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4116 - accuracy: 0.7994
Epoch 143/300
6/6 [==============================] - 0s 583us/step - loss: 0.4112 - accuracy: 0.7994
Epoch 144/300
6/6 [==============================] - 0s 559us/step - loss: 0.4108 - accuracy: 0.7994
Epoch 145/300
6/6 [==============================] - 0s 552us/step - loss: 0.4104 - accuracy: 0.7994
Epoch 146/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4102 - accuracy: 0.7994
Epoch 147/300
6/6 [==============================] - 0s 590us/step - loss: 0.4098 - accuracy: 0.7994
Epoch 148/300
6/6 [==============================] - 0s 560us/step - loss: 0.4095 - accuracy: 0.8023
Epoch 149/300
6/6 [==============================] - 0s 546us/step - loss: 0.4091 - accuracy: 0.8023
Epoch 150/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4089 - accuracy: 0.8023
Epoch 151/300
6/6 [==============================] - 0s 567us/step - loss: 0.4083 - accuracy: 0.8023
Epoch 152/300
6/6 [==============================] - 0s 575us/step - loss: 0.4081 - accuracy: 0.8023
Epoch 153/300
6/6 [==============================] - 0s 586us/step - loss: 0.4075 - accuracy: 0.8023
Epoch 154/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4073 - accuracy: 0.8052
Epoch 155/300
6/6 [==============================] - 0s 532us/step - loss: 0.4070 - accuracy: 0.8052
Epoch 156/300
6/6 [==============================] - 0s 530us/step - loss: 0.4066 - accuracy: 0.8052
Epoch 157/300
6/6 [==============================] - 0s 525us/step - loss: 0.4065 - accuracy: 0.8052
Epoch 158/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4061 - accuracy: 0.8052
Epoch 159/300
6/6 [==============================] - 0s 531us/step - loss: 0.4055 - accuracy: 0.8052
Epoch 160/300
6/6 [==============================] - 0s 556us/step - loss: 0.4051 - accuracy: 0.8081
Epoch 161/300
6/6 [==============================] - 0s 545us/step - loss: 0.4048 - accuracy: 0.8081
Epoch 162/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4044 - accuracy: 0.8052
Epoch 163/300
6/6 [==============================] - 0s 541us/step - loss: 0.4042 - accuracy: 0.8052
Epoch 164/300
6/6 [==============================] - 0s 586us/step - loss: 0.4038 - accuracy: 0.8081
Epoch 165/300
6/6 [==============================] - 0s 535us/step - loss: 0.4036 - accuracy: 0.8052
Epoch 166/300
6/6 [==============================] - 0s 543us/step - loss: 0.4032 - accuracy: 0.8081
Epoch 167/300
6/6 [==============================] - 0s 556us/step - loss: 0.4028 - accuracy: 0.8081
Epoch 168/300
6/6 [==============================] - 0s 607us/step - loss: 0.4024 - accuracy: 0.8081
Epoch 169/300
6/6 [==============================] - 0s 551us/step - loss: 0.4021 - accuracy: 0.8081
Epoch 170/300
6/6 [==============================] - 0s 592us/step - loss: 0.4020 - accuracy: 0.8081
Epoch 171/300
6/6 [==============================] - 0s 578us/step - loss: 0.4015 - accuracy: 0.8052
Epoch 172/300
6/6 [==============================] - 0s 565us/step - loss: 0.4012 - accuracy: 0.8052
Epoch 173/300
6/6 [==============================] - 0s 554us/step - loss: 0.4009 - accuracy: 0.8081
Epoch 174/300
6/6 [==============================] - 0s 558us/step - loss: 0.4004 - accuracy: 0.8140
Epoch 175/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4000 - accuracy: 0.8110
Epoch 176/300
6/6 [==============================] - 0s 579us/step - loss: 0.3997 - accuracy: 0.8110
Epoch 177/300
6/6 [==============================] - 0s 579us/step - loss: 0.3993 - accuracy: 0.8110
Epoch 178/300
6/6 [==============================] - 0s 593us/step - loss: 0.3992 - accuracy: 0.8110
Epoch 179/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3987 - accuracy: 0.8110
Epoch 180/300
6/6 [==============================] - 0s 560us/step - loss: 0.3985 - accuracy: 0.8081
Epoch 181/300
6/6 [==============================] - 0s 580us/step - loss: 0.3983 - accuracy: 0.8110
Epoch 182/300
6/6 [==============================] - 0s 579us/step - loss: 0.3980 - accuracy: 0.8110
Epoch 183/300
6/6 [==============================] - 0s 569us/step - loss: 0.3977 - accuracy: 0.8110
Epoch 184/300
6/6 [==============================] - 0s 574us/step - loss: 0.3975 - accuracy: 0.8081
Epoch 185/300
6/6 [==============================] - 0s 573us/step - loss: 0.3971 - accuracy: 0.8081
Epoch 186/300
6/6 [==============================] - 0s 551us/step - loss: 0.3969 - accuracy: 0.8081
Epoch 187/300
6/6 [==============================] - 0s 561us/step - loss: 0.3967 - accuracy: 0.8140
Epoch 188/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3965 - accuracy: 0.8140
Epoch 189/300
6/6 [==============================] - 0s 579us/step - loss: 0.3961 - accuracy: 0.8140
Epoch 190/300
6/6 [==============================] - 0s 591us/step - loss: 0.3959 - accuracy: 0.8140
Epoch 191/300
6/6 [==============================] - 0s 567us/step - loss: 0.3956 - accuracy: 0.8140
Epoch 192/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3954 - accuracy: 0.8140
Epoch 193/300
6/6 [==============================] - 0s 581us/step - loss: 0.3952 - accuracy: 0.8140
Epoch 194/300
6/6 [==============================] - 0s 589us/step - loss: 0.3949 - accuracy: 0.8140
Epoch 195/300
6/6 [==============================] - 0s 586us/step - loss: 0.3947 - accuracy: 0.8110
Epoch 196/300
6/6 [==============================] - 0s 624us/step - loss: 0.3947 - accuracy: 0.8110
Epoch 197/300
6/6 [==============================] - 0s 592us/step - loss: 0.3943 - accuracy: 0.8110
Epoch 198/300
6/6 [==============================] - 0s 556us/step - loss: 0.3940 - accuracy: 0.8110
Epoch 199/300
6/6 [==============================] - 0s 558us/step - loss: 0.3939 - accuracy: 0.8110
Epoch 200/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3936 - accuracy: 0.8052
Epoch 201/300
6/6 [==============================] - 0s 576us/step - loss: 0.3935 - accuracy: 0.8023
Epoch 202/300
6/6 [==============================] - 0s 559us/step - loss: 0.3932 - accuracy: 0.8023
Epoch 203/300
6/6 [==============================] - 0s 568us/step - loss: 0.3931 - accuracy: 0.8023
Epoch 204/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3926 - accuracy: 0.8052
Epoch 205/300
6/6 [==============================] - 0s 568us/step - loss: 0.3923 - accuracy: 0.8052
Epoch 206/300
6/6 [==============================] - 0s 563us/step - loss: 0.3922 - accuracy: 0.8052
Epoch 207/300
6/6 [==============================] - 0s 569us/step - loss: 0.3920 - accuracy: 0.8081
Epoch 208/300
6/6 [==============================] - 0s 579us/step - loss: 0.3916 - accuracy: 0.8023
Epoch 209/300
6/6 [==============================] - 0s 603us/step - loss: 0.3914 - accuracy: 0.8023
Epoch 210/300
6/6 [==============================] - 0s 585us/step - loss: 0.3912 - accuracy: 0.8023
Epoch 211/300
6/6 [==============================] - 0s 557us/step - loss: 0.3909 - accuracy: 0.8023
Epoch 212/300
6/6 [==============================] - 0s 567us/step - loss: 0.3907 - accuracy: 0.8023
Epoch 213/300
6/6 [==============================] - 0s 597us/step - loss: 0.3906 - accuracy: 0.8052
Epoch 214/300
6/6 [==============================] - 0s 570us/step - loss: 0.3904 - accuracy: 0.8052
Epoch 215/300
6/6 [==============================] - 0s 543us/step - loss: 0.3901 - accuracy: 0.8052
Epoch 216/300
6/6 [==============================] - 0s 556us/step - loss: 0.3898 - accuracy: 0.8052
Epoch 217/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3898 - accuracy: 0.8052
Epoch 218/300
6/6 [==============================] - 0s 567us/step - loss: 0.3896 - accuracy: 0.8023
Epoch 219/300
6/6 [==============================] - 0s 576us/step - loss: 0.3892 - accuracy: 0.8052
Epoch 220/300
6/6 [==============================] - 0s 563us/step - loss: 0.3888 - accuracy: 0.8052
Epoch 221/300
6/6 [==============================] - 0s 550us/step - loss: 0.3889 - accuracy: 0.8052
Epoch 222/300
6/6 [==============================] - 0s 571us/step - loss: 0.3886 - accuracy: 0.8081
Epoch 223/300
6/6 [==============================] - 0s 574us/step - loss: 0.3885 - accuracy: 0.8081
Epoch 224/300
6/6 [==============================] - 0s 567us/step - loss: 0.3881 - accuracy: 0.8081
Epoch 225/300
6/6 [==============================] - 0s 578us/step - loss: 0.3878 - accuracy: 0.8081
Epoch 226/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3875 - accuracy: 0.8081
Epoch 227/300
6/6 [==============================] - 0s 573us/step - loss: 0.3873 - accuracy: 0.8081
Epoch 228/300
6/6 [==============================] - 0s 570us/step - loss: 0.3869 - accuracy: 0.8052
Epoch 229/300
6/6 [==============================] - 0s 584us/step - loss: 0.3868 - accuracy: 0.8081
Epoch 230/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3863 - accuracy: 0.8023
Epoch 231/300
6/6 [==============================] - 0s 594us/step - loss: 0.3865 - accuracy: 0.8052
Epoch 232/300
6/6 [==============================] - 0s 572us/step - loss: 0.3861 - accuracy: 0.8023
Epoch 233/300
6/6 [==============================] - 0s 560us/step - loss: 0.3858 - accuracy: 0.8052
Epoch 234/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3857 - accuracy: 0.8052
Epoch 235/300
6/6 [==============================] - 0s 570us/step - loss: 0.3854 - accuracy: 0.8081
Epoch 236/300
6/6 [==============================] - 0s 561us/step - loss: 0.3851 - accuracy: 0.8081
Epoch 237/300
6/6 [==============================] - 0s 583us/step - loss: 0.3849 - accuracy: 0.8081
Epoch 238/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3848 - accuracy: 0.8081
Epoch 239/300
6/6 [==============================] - 0s 574us/step - loss: 0.3848 - accuracy: 0.8081
Epoch 240/300
6/6 [==============================] - 0s 552us/step - loss: 0.3844 - accuracy: 0.8023
Epoch 241/300
6/6 [==============================] - 0s 577us/step - loss: 0.3843 - accuracy: 0.8023
Epoch 242/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3839 - accuracy: 0.8052
Epoch 243/300
6/6 [==============================] - 0s 585us/step - loss: 0.3838 - accuracy: 0.8052
Epoch 244/300
6/6 [==============================] - 0s 577us/step - loss: 0.3836 - accuracy: 0.8052
Epoch 245/300
6/6 [==============================] - 0s 556us/step - loss: 0.3837 - accuracy: 0.8023
Epoch 246/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3833 - accuracy: 0.8081
Epoch 247/300
6/6 [==============================] - 0s 571us/step - loss: 0.3831 - accuracy: 0.8081
Epoch 248/300
6/6 [==============================] - 0s 544us/step - loss: 0.3829 - accuracy: 0.8081
Epoch 249/300
6/6 [==============================] - 0s 552us/step - loss: 0.3828 - accuracy: 0.8052
Epoch 250/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3825 - accuracy: 0.8023
Epoch 251/300
6/6 [==============================] - 0s 559us/step - loss: 0.3822 - accuracy: 0.8023
Epoch 252/300
6/6 [==============================] - 0s 555us/step - loss: 0.3821 - accuracy: 0.8023
Epoch 253/300
6/6 [==============================] - 0s 548us/step - loss: 0.3818 - accuracy: 0.8023
Epoch 254/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3817 - accuracy: 0.8052
Epoch 255/300
6/6 [==============================] - 0s 576us/step - loss: 0.3815 - accuracy: 0.8052
Epoch 256/300
6/6 [==============================] - 0s 558us/step - loss: 0.3812 - accuracy: 0.8023
Epoch 257/300
6/6 [==============================] - 0s 560us/step - loss: 0.3809 - accuracy: 0.8023
Epoch 258/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3806 - accuracy: 0.8023
Epoch 259/300
6/6 [==============================] - 0s 566us/step - loss: 0.3804 - accuracy: 0.8052
Epoch 260/300
6/6 [==============================] - 0s 565us/step - loss: 0.3807 - accuracy: 0.8052
Epoch 261/300
6/6 [==============================] - 0s 568us/step - loss: 0.3805 - accuracy: 0.8081
Epoch 262/300
6/6 [==============================] - 0s 575us/step - loss: 0.3800 - accuracy: 0.8023
Epoch 263/300
6/6 [==============================] - 0s 585us/step - loss: 0.3796 - accuracy: 0.8023
Epoch 264/300
6/6 [==============================] - 0s 559us/step - loss: 0.3794 - accuracy: 0.8023
Epoch 265/300
6/6 [==============================] - 0s 605us/step - loss: 0.3792 - accuracy: 0.8052
Epoch 266/300
6/6 [==============================] - 0s 588us/step - loss: 0.3790 - accuracy: 0.8023
Epoch 267/300
6/6 [==============================] - 0s 568us/step - loss: 0.3788 - accuracy: 0.8052
Epoch 268/300
6/6 [==============================] - 0s 574us/step - loss: 0.3785 - accuracy: 0.8052
Epoch 269/300
6/6 [==============================] - 0s 568us/step - loss: 0.3783 - accuracy: 0.8023
Epoch 270/300
6/6 [==============================] - 0s 600us/step - loss: 0.3783 - accuracy: 0.8023
Epoch 271/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3780 - accuracy: 0.8052
Epoch 272/300
6/6 [==============================] - 0s 625us/step - loss: 0.3778 - accuracy: 0.8052
Epoch 273/300
6/6 [==============================] - 0s 621us/step - loss: 0.3777 - accuracy: 0.8052
Epoch 274/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3774 - accuracy: 0.8052
Epoch 275/300
6/6 [==============================] - 0s 555us/step - loss: 0.3776 - accuracy: 0.7994
Epoch 276/300
6/6 [==============================] - 0s 563us/step - loss: 0.3771 - accuracy: 0.8052
Epoch 277/300
6/6 [==============================] - 0s 15ms/step - loss: 0.3769 - accuracy: 0.8023
Epoch 278/300
6/6 [==============================] - 0s 585us/step - loss: 0.3769 - accuracy: 0.8023
Epoch 279/300
6/6 [==============================] - 0s 573us/step - loss: 0.3766 - accuracy: 0.8023
Epoch 280/300
6/6 [==============================] - 0s 553us/step - loss: 0.3765 - accuracy: 0.8023
Epoch 281/300
6/6 [==============================] - 0s 575us/step - loss: 0.3763 - accuracy: 0.8023
Epoch 282/300
6/6 [==============================] - 0s 558us/step - loss: 0.3760 - accuracy: 0.8052
Epoch 283/300
6/6 [==============================] - 0s 558us/step - loss: 0.3757 - accuracy: 0.8052
Epoch 284/300
6/6 [==============================] - 0s 557us/step - loss: 0.3756 - accuracy: 0.8052
Epoch 285/300
6/6 [==============================] - 0s 558us/step - loss: 0.3755 - accuracy: 0.8052
Epoch 286/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3751 - accuracy: 0.8052
Epoch 287/300
6/6 [==============================] - 0s 570us/step - loss: 0.3749 - accuracy: 0.8052
Epoch 288/300
6/6 [==============================] - 0s 586us/step - loss: 0.3750 - accuracy: 0.8081
Epoch 289/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3747 - accuracy: 0.8052
Epoch 290/300
6/6 [==============================] - 0s 566us/step - loss: 0.3746 - accuracy: 0.8052
Epoch 291/300
6/6 [==============================] - 0s 571us/step - loss: 0.3743 - accuracy: 0.8052
Epoch 292/300
6/6 [==============================] - 0s 589us/step - loss: 0.3741 - accuracy: 0.8052
Epoch 293/300
6/6 [==============================] - 0s 574us/step - loss: 0.3739 - accuracy: 0.8052
Epoch 294/300
6/6 [==============================] - 0s 537us/step - loss: 0.3738 - accuracy: 0.8081
Epoch 295/300
6/6 [==============================] - 0s 563us/step - loss: 0.3739 - accuracy: 0.8052
Epoch 296/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3735 - accuracy: 0.8052
Epoch 297/300
6/6 [==============================] - 0s 587us/step - loss: 0.3732 - accuracy: 0.8052
Epoch 298/300
6/6 [==============================] - 0s 575us/step - loss: 0.3733 - accuracy: 0.8081
Epoch 299/300
6/6 [==============================] - 0s 558us/step - loss: 0.3729 - accuracy: 0.8081
Epoch 300/300
6/6 [==============================] - 0s 579us/step - loss: 0.3727 - accuracy: 0.8081
Epoch 1/300
6/6 [==============================] - 0s 688us/step - loss: 0.6571 - accuracy: 0.6628
Epoch 2/300
6/6 [==============================] - 0s 574us/step - loss: 0.6440 - accuracy: 0.6686
Epoch 3/300
6/6 [==============================] - 0s 582us/step - loss: 0.6320 - accuracy: 0.6890
Epoch 4/300
6/6 [==============================] - 0s 581us/step - loss: 0.6209 - accuracy: 0.6890
Epoch 5/300
6/6 [==============================] - 0s 15ms/step - loss: 0.6099 - accuracy: 0.6890
Epoch 6/300
6/6 [==============================] - 0s 580us/step - loss: 0.6000 - accuracy: 0.6919
Epoch 7/300
6/6 [==============================] - 0s 15ms/step - loss: 0.5903 - accuracy: 0.6948
Epoch 8/300
6/6 [==============================] - 0s 586us/step - loss: 0.5812 - accuracy: 0.7035
Epoch 9/300
6/6 [==============================] - 0s 577us/step - loss: 0.5728 - accuracy: 0.7006
Epoch 10/300
6/6 [==============================] - 0s 581us/step - loss: 0.5650 - accuracy: 0.7006
Epoch 11/300
6/6 [==============================] - 0s 569us/step - loss: 0.5580 - accuracy: 0.7064
Epoch 12/300
6/6 [==============================] - 0s 15ms/step - loss: 0.5507 - accuracy: 0.7035
Epoch 13/300
6/6 [==============================] - 0s 557us/step - loss: 0.5447 - accuracy: 0.7064
Epoch 14/300
6/6 [==============================] - 0s 566us/step - loss: 0.5385 - accuracy: 0.7093
Epoch 15/300
6/6 [==============================] - 0s 573us/step - loss: 0.5323 - accuracy: 0.7267
Epoch 16/300
6/6 [==============================] - 0s 565us/step - loss: 0.5268 - accuracy: 0.7326
Epoch 17/300
6/6 [==============================] - 0s 560us/step - loss: 0.5212 - accuracy: 0.7384
Epoch 18/300
6/6 [==============================] - 0s 603us/step - loss: 0.5163 - accuracy: 0.7442
Epoch 19/300
6/6 [==============================] - 0s 583us/step - loss: 0.5115 - accuracy: 0.7471
Epoch 20/300
6/6 [==============================] - 0s 15ms/step - loss: 0.5066 - accuracy: 0.7471
Epoch 21/300
6/6 [==============================] - 0s 587us/step - loss: 0.5024 - accuracy: 0.7442
Epoch 22/300
6/6 [==============================] - 0s 578us/step - loss: 0.4980 - accuracy: 0.7529
Epoch 23/300
6/6 [==============================] - 0s 624us/step - loss: 0.4938 - accuracy: 0.7558
Epoch 24/300
6/6 [==============================] - 0s 574us/step - loss: 0.4904 - accuracy: 0.7558
Epoch 25/300
6/6 [==============================] - 0s 579us/step - loss: 0.4868 - accuracy: 0.7733
Epoch 26/300
6/6 [==============================] - 0s 592us/step - loss: 0.4836 - accuracy: 0.7733
Epoch 27/300
6/6 [==============================] - 0s 565us/step - loss: 0.4808 - accuracy: 0.7762
Epoch 28/300
6/6 [==============================] - 0s 564us/step - loss: 0.4779 - accuracy: 0.7762
Epoch 29/300
6/6 [==============================] - 0s 15ms/step - loss: 0.4758 - accuracy: 0.7762
Epoch 30/300
6/6 [==============================] - 0s 555us/step - loss: 0.4731 - accuracy: 0.7762
Epoch 31/300
6/6 [==============================] - 0s 607us/step - loss: 0.4709 - accuracy: 0.7762
Epoch 32/300
6/6 [==============================] - 0s 836us/step - loss: 0.4689 - accuracy: 0.7791
Epoch 33/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4667 - accuracy: 0.7762
Epoch 34/300
6/6 [==============================] - 0s 882us/step - loss: 0.4649 - accuracy: 0.7762
Epoch 35/300
6/6 [==============================] - 0s 784us/step - loss: 0.4629 - accuracy: 0.7762
Epoch 36/300
6/6 [==============================] - 0s 715us/step - loss: 0.4611 - accuracy: 0.7762
Epoch 37/300
6/6 [==============================] - 0s 603us/step - loss: 0.4594 - accuracy: 0.7762
Epoch 38/300
6/6 [==============================] - 0s 610us/step - loss: 0.4576 - accuracy: 0.7762
Epoch 39/300
6/6 [==============================] - 0s 584us/step - loss: 0.4557 - accuracy: 0.7820
Epoch 40/300
6/6 [==============================] - 0s 569us/step - loss: 0.4541 - accuracy: 0.7907
Epoch 41/300
6/6 [==============================] - 0s 560us/step - loss: 0.4525 - accuracy: 0.7936
Epoch 42/300
6/6 [==============================] - 0s 915us/step - loss: 0.4512 - accuracy: 0.7965
Epoch 43/300
6/6 [==============================] - 0s 917us/step - loss: 0.4495 - accuracy: 0.7965
Epoch 44/300
6/6 [==============================] - 0s 896us/step - loss: 0.4483 - accuracy: 0.7994
Epoch 45/300
6/6 [==============================] - 0s 884us/step - loss: 0.4467 - accuracy: 0.7965
Epoch 46/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4454 - accuracy: 0.7965
Epoch 47/300
6/6 [==============================] - 0s 767us/step - loss: 0.4442 - accuracy: 0.7965
Epoch 48/300
6/6 [==============================] - 0s 557us/step - loss: 0.4429 - accuracy: 0.7936
Epoch 49/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4419 - accuracy: 0.7936
Epoch 50/300
6/6 [==============================] - 0s 561us/step - loss: 0.4407 - accuracy: 0.7965
Epoch 51/300
6/6 [==============================] - 0s 554us/step - loss: 0.4394 - accuracy: 0.7965
Epoch 52/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4385 - accuracy: 0.7965
Epoch 53/300
6/6 [==============================] - 0s 555us/step - loss: 0.4374 - accuracy: 0.7965
Epoch 54/300
6/6 [==============================] - 0s 566us/step - loss: 0.4369 - accuracy: 0.8052
Epoch 55/300
6/6 [==============================] - 0s 15ms/step - loss: 0.4356 - accuracy: 0.8052
Epoch 56/300
6/6 [==============================] - 0s 574us/step - loss: 0.4347 - accuracy: 0.8110
Epoch 57/300
6/6 [==============================] - 0s 550us/step - loss: 0.4337 - accuracy: 0.8110
Epoch 58/300
6/6 [==============================] - 0s 15ms/step - loss: 0.4330 - accuracy: 0.8110
Epoch 59/300
6/6 [==============================] - 0s 550us/step - loss: 0.4319 - accuracy: 0.8081
Epoch 60/300
6/6 [==============================] - 0s 549us/step - loss: 0.4310 - accuracy: 0.8110
Epoch 61/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4303 - accuracy: 0.8140
Epoch 62/300
6/6 [==============================] - 0s 578us/step - loss: 0.4294 - accuracy: 0.8140
Epoch 63/300
6/6 [==============================] - 0s 561us/step - loss: 0.4286 - accuracy: 0.8140
Epoch 64/300
6/6 [==============================] - 0s 566us/step - loss: 0.4276 - accuracy: 0.8140
Epoch 65/300
6/6 [==============================] - 0s 557us/step - loss: 0.4268 - accuracy: 0.8140
Epoch 66/300
6/6 [==============================] - 0s 552us/step - loss: 0.4260 - accuracy: 0.8140
Epoch 67/300
6/6 [==============================] - 0s 545us/step - loss: 0.4252 - accuracy: 0.8140
Epoch 68/300
6/6 [==============================] - 0s 15ms/step - loss: 0.4243 - accuracy: 0.8110
Epoch 69/300
6/6 [==============================] - 0s 544us/step - loss: 0.4236 - accuracy: 0.8110
Epoch 70/300
6/6 [==============================] - 0s 563us/step - loss: 0.4230 - accuracy: 0.8110
Epoch 71/300
6/6 [==============================] - 0s 15ms/step - loss: 0.4221 - accuracy: 0.8081
Epoch 72/300
6/6 [==============================] - 0s 549us/step - loss: 0.4214 - accuracy: 0.8081
Epoch 73/300
6/6 [==============================] - 0s 529us/step - loss: 0.4210 - accuracy: 0.8081
Epoch 74/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4202 - accuracy: 0.8081
Epoch 75/300
6/6 [==============================] - 0s 573us/step - loss: 0.4196 - accuracy: 0.8081
Epoch 76/300
6/6 [==============================] - 0s 560us/step - loss: 0.4190 - accuracy: 0.8081
Epoch 77/300
6/6 [==============================] - 0s 546us/step - loss: 0.4183 - accuracy: 0.8081
Epoch 78/300
6/6 [==============================] - 0s 559us/step - loss: 0.4177 - accuracy: 0.8081
Epoch 79/300
6/6 [==============================] - 0s 542us/step - loss: 0.4171 - accuracy: 0.8081
Epoch 80/300
6/6 [==============================] - 0s 534us/step - loss: 0.4165 - accuracy: 0.8052
Epoch 81/300
6/6 [==============================] - 0s 557us/step - loss: 0.4159 - accuracy: 0.8052
Epoch 82/300
6/6 [==============================] - 0s 533us/step - loss: 0.4153 - accuracy: 0.8052
Epoch 83/300
6/6 [==============================] - 0s 535us/step - loss: 0.4147 - accuracy: 0.8052
Epoch 84/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4142 - accuracy: 0.8052
Epoch 85/300
6/6 [==============================] - 0s 558us/step - loss: 0.4135 - accuracy: 0.8081
Epoch 86/300
6/6 [==============================] - 0s 564us/step - loss: 0.4131 - accuracy: 0.8140
Epoch 87/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4125 - accuracy: 0.8140
Epoch 88/300
6/6 [==============================] - 0s 588us/step - loss: 0.4119 - accuracy: 0.8140
Epoch 89/300
6/6 [==============================] - 0s 559us/step - loss: 0.4113 - accuracy: 0.8140
Epoch 90/300
6/6 [==============================] - 0s 575us/step - loss: 0.4108 - accuracy: 0.8110
Epoch 91/300
6/6 [==============================] - 0s 574us/step - loss: 0.4101 - accuracy: 0.8110
Epoch 92/300
6/6 [==============================] - 0s 577us/step - loss: 0.4096 - accuracy: 0.8110
Epoch 93/300
6/6 [==============================] - 0s 550us/step - loss: 0.4090 - accuracy: 0.8110
Epoch 94/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4086 - accuracy: 0.8110
Epoch 95/300
6/6 [==============================] - 0s 560us/step - loss: 0.4084 - accuracy: 0.8081
Epoch 96/300
6/6 [==============================] - 0s 566us/step - loss: 0.4077 - accuracy: 0.8023
Epoch 97/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4073 - accuracy: 0.8052
Epoch 98/300
6/6 [==============================] - 0s 1ms/step - loss: 0.4067 - accuracy: 0.8052
Epoch 99/300
6/6 [==============================] - 0s 544us/step - loss: 0.4062 - accuracy: 0.8052
Epoch 100/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4057 - accuracy: 0.8052
Epoch 101/300
6/6 [==============================] - 0s 528us/step - loss: 0.4055 - accuracy: 0.8052
Epoch 102/300
6/6 [==============================] - 0s 518us/step - loss: 0.4050 - accuracy: 0.8052
Epoch 103/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4044 - accuracy: 0.8052
Epoch 104/300
6/6 [==============================] - 0s 528us/step - loss: 0.4041 - accuracy: 0.8052
Epoch 105/300
6/6 [==============================] - 0s 548us/step - loss: 0.4035 - accuracy: 0.8052
Epoch 106/300
6/6 [==============================] - 0s 570us/step - loss: 0.4031 - accuracy: 0.8052
Epoch 107/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4027 - accuracy: 0.8052
Epoch 108/300
6/6 [==============================] - 0s 544us/step - loss: 0.4023 - accuracy: 0.8023
Epoch 109/300
6/6 [==============================] - 0s 546us/step - loss: 0.4022 - accuracy: 0.8023
Epoch 110/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4016 - accuracy: 0.8023
Epoch 111/300
6/6 [==============================] - 0s 527us/step - loss: 0.4014 - accuracy: 0.8023
Epoch 112/300
6/6 [==============================] - 0s 532us/step - loss: 0.4011 - accuracy: 0.8023
Epoch 113/300
6/6 [==============================] - 0s 552us/step - loss: 0.4006 - accuracy: 0.8023
Epoch 114/300
6/6 [==============================] - 0s 706us/step - loss: 0.4002 - accuracy: 0.8023
Epoch 115/300
6/6 [==============================] - 0s 677us/step - loss: 0.3999 - accuracy: 0.8023
Epoch 116/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3995 - accuracy: 0.8023
Epoch 117/300
6/6 [==============================] - 0s 592us/step - loss: 0.3992 - accuracy: 0.8023
Epoch 118/300
6/6 [==============================] - 0s 582us/step - loss: 0.3988 - accuracy: 0.8052
Epoch 119/300
6/6 [==============================] - 0s 600us/step - loss: 0.3985 - accuracy: 0.8052
Epoch 120/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3982 - accuracy: 0.8052
Epoch 121/300
6/6 [==============================] - 0s 548us/step - loss: 0.3977 - accuracy: 0.8081
Epoch 122/300
6/6 [==============================] - 0s 551us/step - loss: 0.3975 - accuracy: 0.8081
Epoch 123/300
6/6 [==============================] - 0s 534us/step - loss: 0.3971 - accuracy: 0.8081
Epoch 124/300
6/6 [==============================] - 0s 545us/step - loss: 0.3967 - accuracy: 0.8081
Epoch 125/300
6/6 [==============================] - 0s 591us/step - loss: 0.3964 - accuracy: 0.8081
Epoch 126/300
6/6 [==============================] - 0s 629us/step - loss: 0.3959 - accuracy: 0.8081
Epoch 127/300
6/6 [==============================] - 0s 694us/step - loss: 0.3956 - accuracy: 0.8081
Epoch 128/300
6/6 [==============================] - 0s 615us/step - loss: 0.3952 - accuracy: 0.8081
Epoch 129/300
6/6 [==============================] - 0s 618us/step - loss: 0.3948 - accuracy: 0.8081
Epoch 130/300
6/6 [==============================] - 0s 696us/step - loss: 0.3944 - accuracy: 0.8081
Epoch 131/300
6/6 [==============================] - 0s 645us/step - loss: 0.3944 - accuracy: 0.8023
Epoch 132/300
6/6 [==============================] - 0s 589us/step - loss: 0.3939 - accuracy: 0.8023
Epoch 133/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3934 - accuracy: 0.8023
Epoch 134/300
6/6 [==============================] - 0s 624us/step - loss: 0.3930 - accuracy: 0.8023
Epoch 135/300
6/6 [==============================] - 0s 620us/step - loss: 0.3928 - accuracy: 0.8023
Epoch 136/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3923 - accuracy: 0.8081
Epoch 137/300
6/6 [==============================] - 0s 654us/step - loss: 0.3919 - accuracy: 0.8081
Epoch 138/300
6/6 [==============================] - 0s 580us/step - loss: 0.3915 - accuracy: 0.8081
Epoch 139/300
6/6 [==============================] - 0s 15ms/step - loss: 0.3912 - accuracy: 0.8081
Epoch 140/300
6/6 [==============================] - 0s 649us/step - loss: 0.3909 - accuracy: 0.8081
Epoch 141/300
6/6 [==============================] - 0s 625us/step - loss: 0.3904 - accuracy: 0.8052
Epoch 142/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3901 - accuracy: 0.8081
Epoch 143/300
6/6 [==============================] - 0s 602us/step - loss: 0.3897 - accuracy: 0.8081
Epoch 144/300
6/6 [==============================] - 0s 627us/step - loss: 0.3893 - accuracy: 0.8052
Epoch 145/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3890 - accuracy: 0.8052
Epoch 146/300
6/6 [==============================] - 0s 620us/step - loss: 0.3886 - accuracy: 0.8052
Epoch 147/300
6/6 [==============================] - 0s 611us/step - loss: 0.3883 - accuracy: 0.8052
Epoch 148/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3881 - accuracy: 0.8052
Epoch 149/300
6/6 [==============================] - 0s 652us/step - loss: 0.3880 - accuracy: 0.8052
Epoch 150/300
6/6 [==============================] - 0s 642us/step - loss: 0.3874 - accuracy: 0.8052
Epoch 151/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3871 - accuracy: 0.8052
Epoch 152/300
6/6 [==============================] - 0s 633us/step - loss: 0.3871 - accuracy: 0.8052
Epoch 153/300
6/6 [==============================] - 0s 647us/step - loss: 0.3866 - accuracy: 0.8052
Epoch 154/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3864 - accuracy: 0.8052
Epoch 155/300
6/6 [==============================] - 0s 639us/step - loss: 0.3861 - accuracy: 0.8052
Epoch 156/300
6/6 [==============================] - 0s 585us/step - loss: 0.3863 - accuracy: 0.8081
Epoch 157/300
6/6 [==============================] - 0s 592us/step - loss: 0.3858 - accuracy: 0.8081
Epoch 158/300
6/6 [==============================] - 0s 604us/step - loss: 0.3856 - accuracy: 0.8110
Epoch 159/300
6/6 [==============================] - 0s 586us/step - loss: 0.3854 - accuracy: 0.8110
Epoch 160/300
6/6 [==============================] - 0s 566us/step - loss: 0.3851 - accuracy: 0.8140
Epoch 161/300
6/6 [==============================] - 0s 579us/step - loss: 0.3851 - accuracy: 0.8140
Epoch 162/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3847 - accuracy: 0.8110
Epoch 163/300
6/6 [==============================] - 0s 569us/step - loss: 0.3845 - accuracy: 0.8110
Epoch 164/300
6/6 [==============================] - 0s 562us/step - loss: 0.3844 - accuracy: 0.8110
Epoch 165/300
6/6 [==============================] - 0s 545us/step - loss: 0.3840 - accuracy: 0.8110
Epoch 166/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3836 - accuracy: 0.8140
Epoch 167/300
6/6 [==============================] - 0s 569us/step - loss: 0.3835 - accuracy: 0.8081
Epoch 168/300
6/6 [==============================] - 0s 560us/step - loss: 0.3832 - accuracy: 0.8110
Epoch 169/300
6/6 [==============================] - 0s 553us/step - loss: 0.3832 - accuracy: 0.8110
Epoch 170/300
6/6 [==============================] - 0s 559us/step - loss: 0.3827 - accuracy: 0.8110
Epoch 171/300
6/6 [==============================] - 0s 566us/step - loss: 0.3825 - accuracy: 0.8081
Epoch 172/300
6/6 [==============================] - 0s 558us/step - loss: 0.3824 - accuracy: 0.8110
Epoch 173/300
6/6 [==============================] - 0s 541us/step - loss: 0.3822 - accuracy: 0.8081
Epoch 174/300
6/6 [==============================] - 0s 552us/step - loss: 0.3818 - accuracy: 0.8081
Epoch 175/300
6/6 [==============================] - 0s 569us/step - loss: 0.3815 - accuracy: 0.8081
Epoch 176/300
6/6 [==============================] - 0s 568us/step - loss: 0.3814 - accuracy: 0.8081
Epoch 177/300
6/6 [==============================] - 0s 547us/step - loss: 0.3811 - accuracy: 0.8081
Epoch 178/300
6/6 [==============================] - 0s 553us/step - loss: 0.3808 - accuracy: 0.8081
Epoch 179/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3806 - accuracy: 0.8081
Epoch 180/300
6/6 [==============================] - 0s 562us/step - loss: 0.3806 - accuracy: 0.8081
Epoch 181/300
6/6 [==============================] - 0s 551us/step - loss: 0.3801 - accuracy: 0.8110
Epoch 182/300
6/6 [==============================] - 0s 560us/step - loss: 0.3799 - accuracy: 0.8110
Epoch 183/300
6/6 [==============================] - 0s 547us/step - loss: 0.3796 - accuracy: 0.8110
Epoch 184/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3793 - accuracy: 0.8110
Epoch 185/300
6/6 [==============================] - 0s 541us/step - loss: 0.3791 - accuracy: 0.8110
Epoch 186/300
6/6 [==============================] - 0s 547us/step - loss: 0.3788 - accuracy: 0.8110
Epoch 187/300
6/6 [==============================] - 0s 538us/step - loss: 0.3787 - accuracy: 0.8110
Epoch 188/300
6/6 [==============================] - 0s 578us/step - loss: 0.3785 - accuracy: 0.8081
Epoch 189/300
6/6 [==============================] - 0s 604us/step - loss: 0.3782 - accuracy: 0.8081
Epoch 190/300
6/6 [==============================] - 0s 629us/step - loss: 0.3780 - accuracy: 0.8081
Epoch 191/300
6/6 [==============================] - 0s 621us/step - loss: 0.3777 - accuracy: 0.8110
Epoch 192/300
6/6 [==============================] - 0s 620us/step - loss: 0.3774 - accuracy: 0.8110
Epoch 193/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3774 - accuracy: 0.8110
Epoch 194/300
6/6 [==============================] - 0s 616us/step - loss: 0.3773 - accuracy: 0.8110
Epoch 195/300
6/6 [==============================] - 0s 629us/step - loss: 0.3771 - accuracy: 0.8110
Epoch 196/300
6/6 [==============================] - 0s 649us/step - loss: 0.3767 - accuracy: 0.8110
Epoch 197/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3765 - accuracy: 0.8110
Epoch 198/300
6/6 [==============================] - 0s 657us/step - loss: 0.3763 - accuracy: 0.8110
Epoch 199/300
6/6 [==============================] - 0s 631us/step - loss: 0.3761 - accuracy: 0.8081
Epoch 200/300
6/6 [==============================] - 0s 649us/step - loss: 0.3761 - accuracy: 0.8081
Epoch 201/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3757 - accuracy: 0.8110
Epoch 202/300
6/6 [==============================] - 0s 645us/step - loss: 0.3755 - accuracy: 0.8110
Epoch 203/300
6/6 [==============================] - 0s 616us/step - loss: 0.3754 - accuracy: 0.8110
Epoch 204/300
6/6 [==============================] - 0s 595us/step - loss: 0.3751 - accuracy: 0.8110
Epoch 205/300
6/6 [==============================] - 0s 614us/step - loss: 0.3749 - accuracy: 0.8081
Epoch 206/300
6/6 [==============================] - 0s 614us/step - loss: 0.3747 - accuracy: 0.8081
Epoch 207/300
6/6 [==============================] - 0s 544us/step - loss: 0.3746 - accuracy: 0.8081
Epoch 208/300
6/6 [==============================] - 0s 591us/step - loss: 0.3743 - accuracy: 0.8110
Epoch 209/300
6/6 [==============================] - 0s 633us/step - loss: 0.3742 - accuracy: 0.8140
Epoch 210/300
6/6 [==============================] - 0s 673us/step - loss: 0.3739 - accuracy: 0.8110
Epoch 211/300
6/6 [==============================] - 0s 599us/step - loss: 0.3737 - accuracy: 0.8110
Epoch 212/300
6/6 [==============================] - 0s 644us/step - loss: 0.3735 - accuracy: 0.8081
Epoch 213/300
6/6 [==============================] - 0s 641us/step - loss: 0.3731 - accuracy: 0.8140
Epoch 214/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3730 - accuracy: 0.8140
Epoch 215/300
6/6 [==============================] - 0s 674us/step - loss: 0.3729 - accuracy: 0.8140
Epoch 216/300
6/6 [==============================] - 0s 601us/step - loss: 0.3730 - accuracy: 0.8140
Epoch 217/300
6/6 [==============================] - 0s 641us/step - loss: 0.3727 - accuracy: 0.8169
Epoch 218/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3723 - accuracy: 0.8169
Epoch 219/300
6/6 [==============================] - 0s 640us/step - loss: 0.3721 - accuracy: 0.8140
Epoch 220/300
6/6 [==============================] - 0s 621us/step - loss: 0.3719 - accuracy: 0.8140
Epoch 221/300
6/6 [==============================] - 0s 630us/step - loss: 0.3715 - accuracy: 0.8110
Epoch 222/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3713 - accuracy: 0.8140
Epoch 223/300
6/6 [==============================] - 0s 620us/step - loss: 0.3713 - accuracy: 0.8140
Epoch 224/300
6/6 [==============================] - 0s 648us/step - loss: 0.3709 - accuracy: 0.8140
Epoch 225/300
6/6 [==============================] - 0s 615us/step - loss: 0.3706 - accuracy: 0.8140
Epoch 226/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3705 - accuracy: 0.8140
Epoch 227/300
6/6 [==============================] - 0s 624us/step - loss: 0.3702 - accuracy: 0.8169
Epoch 228/300
6/6 [==============================] - 0s 639us/step - loss: 0.3702 - accuracy: 0.8169
Epoch 229/300
6/6 [==============================] - 0s 613us/step - loss: 0.3701 - accuracy: 0.8140
Epoch 230/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3698 - accuracy: 0.8169
Epoch 231/300
6/6 [==============================] - 0s 674us/step - loss: 0.3697 - accuracy: 0.8140
Epoch 232/300
6/6 [==============================] - 0s 639us/step - loss: 0.3695 - accuracy: 0.8140
Epoch 233/300
6/6 [==============================] - 0s 652us/step - loss: 0.3694 - accuracy: 0.8110
Epoch 234/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3692 - accuracy: 0.8110
Epoch 235/300
6/6 [==============================] - 0s 637us/step - loss: 0.3689 - accuracy: 0.8140
Epoch 236/300
6/6 [==============================] - 0s 652us/step - loss: 0.3689 - accuracy: 0.8169
Epoch 237/300
6/6 [==============================] - 0s 626us/step - loss: 0.3691 - accuracy: 0.8169
Epoch 238/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3686 - accuracy: 0.8169
Epoch 239/300
6/6 [==============================] - 0s 670us/step - loss: 0.3680 - accuracy: 0.8110
Epoch 240/300
6/6 [==============================] - 0s 620us/step - loss: 0.3679 - accuracy: 0.8052
Epoch 241/300
6/6 [==============================] - 0s 609us/step - loss: 0.3679 - accuracy: 0.8081
Epoch 242/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3674 - accuracy: 0.8081
Epoch 243/300
6/6 [==============================] - 0s 611us/step - loss: 0.3671 - accuracy: 0.8110
Epoch 244/300
6/6 [==============================] - 0s 637us/step - loss: 0.3670 - accuracy: 0.8081
Epoch 245/300
6/6 [==============================] - 0s 637us/step - loss: 0.3669 - accuracy: 0.8081
Epoch 246/300
6/6 [==============================] - 0s 658us/step - loss: 0.3665 - accuracy: 0.8081
Epoch 247/300
6/6 [==============================] - 0s 637us/step - loss: 0.3664 - accuracy: 0.8081
Epoch 248/300
6/6 [==============================] - 0s 651us/step - loss: 0.3663 - accuracy: 0.8110
Epoch 249/300
6/6 [==============================] - 0s 582us/step - loss: 0.3661 - accuracy: 0.8110
Epoch 250/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3658 - accuracy: 0.8110
Epoch 251/300
6/6 [==============================] - 0s 648us/step - loss: 0.3656 - accuracy: 0.8110
Epoch 252/300
6/6 [==============================] - 0s 630us/step - loss: 0.3655 - accuracy: 0.8110
Epoch 253/300
6/6 [==============================] - 0s 641us/step - loss: 0.3652 - accuracy: 0.8110
Epoch 254/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3650 - accuracy: 0.8110
Epoch 255/300
6/6 [==============================] - 0s 586us/step - loss: 0.3649 - accuracy: 0.8110
Epoch 256/300
6/6 [==============================] - 0s 584us/step - loss: 0.3645 - accuracy: 0.8081
Epoch 257/300
6/6 [==============================] - 0s 543us/step - loss: 0.3646 - accuracy: 0.8110
Epoch 258/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3642 - accuracy: 0.8110
Epoch 259/300
6/6 [==============================] - 0s 593us/step - loss: 0.3641 - accuracy: 0.8110
Epoch 260/300
6/6 [==============================] - 0s 640us/step - loss: 0.3639 - accuracy: 0.8081
Epoch 261/300
6/6 [==============================] - 0s 624us/step - loss: 0.3636 - accuracy: 0.8081
Epoch 262/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3635 - accuracy: 0.8110
Epoch 263/300
6/6 [==============================] - 0s 630us/step - loss: 0.3635 - accuracy: 0.8140
Epoch 264/300
6/6 [==============================] - 0s 640us/step - loss: 0.3632 - accuracy: 0.8110
Epoch 265/300
6/6 [==============================] - 0s 638us/step - loss: 0.3629 - accuracy: 0.8110
Epoch 266/300
6/6 [==============================] - 0s 589us/step - loss: 0.3628 - accuracy: 0.8110
Epoch 267/300
6/6 [==============================] - 0s 622us/step - loss: 0.3630 - accuracy: 0.8140
Epoch 268/300
6/6 [==============================] - 0s 609us/step - loss: 0.3625 - accuracy: 0.8110
Epoch 269/300
6/6 [==============================] - 0s 644us/step - loss: 0.3623 - accuracy: 0.8140
Epoch 270/300
6/6 [==============================] - 0s 630us/step - loss: 0.3621 - accuracy: 0.8110
Epoch 271/300
6/6 [==============================] - 0s 609us/step - loss: 0.3621 - accuracy: 0.8140
Epoch 272/300
6/6 [==============================] - 0s 639us/step - loss: 0.3622 - accuracy: 0.8110
Epoch 273/300
6/6 [==============================] - 0s 662us/step - loss: 0.3619 - accuracy: 0.8140
Epoch 274/300
6/6 [==============================] - 0s 672us/step - loss: 0.3614 - accuracy: 0.8140
Epoch 275/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3612 - accuracy: 0.8110
Epoch 276/300
6/6 [==============================] - 0s 650us/step - loss: 0.3613 - accuracy: 0.8052
Epoch 277/300
6/6 [==============================] - 0s 636us/step - loss: 0.3608 - accuracy: 0.7994
Epoch 278/300
6/6 [==============================] - 0s 646us/step - loss: 0.3609 - accuracy: 0.8110
Epoch 279/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3606 - accuracy: 0.8169
Epoch 280/300
6/6 [==============================] - 0s 672us/step - loss: 0.3603 - accuracy: 0.8052
Epoch 281/300
6/6 [==============================] - 0s 681us/step - loss: 0.3600 - accuracy: 0.8081
Epoch 282/300
6/6 [==============================] - 0s 613us/step - loss: 0.3599 - accuracy: 0.8198
Epoch 283/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3599 - accuracy: 0.8198
Epoch 284/300
6/6 [==============================] - 0s 635us/step - loss: 0.3596 - accuracy: 0.8198
Epoch 285/300
6/6 [==============================] - 0s 578us/step - loss: 0.3594 - accuracy: 0.8198
Epoch 286/300
6/6 [==============================] - 0s 573us/step - loss: 0.3592 - accuracy: 0.8169
Epoch 287/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3593 - accuracy: 0.8169
Epoch 288/300
6/6 [==============================] - 0s 587us/step - loss: 0.3591 - accuracy: 0.8110
Epoch 289/300
6/6 [==============================] - 0s 597us/step - loss: 0.3590 - accuracy: 0.8140
Epoch 290/300
6/6 [==============================] - 0s 630us/step - loss: 0.3589 - accuracy: 0.8140
Epoch 291/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3585 - accuracy: 0.8198
Epoch 292/300
6/6 [==============================] - 0s 633us/step - loss: 0.3583 - accuracy: 0.8169
Epoch 293/300
6/6 [==============================] - 0s 581us/step - loss: 0.3582 - accuracy: 0.8198
Epoch 294/300
6/6 [==============================] - 0s 569us/step - loss: 0.3582 - accuracy: 0.8227
Epoch 295/300
6/6 [==============================] - 0s 634us/step - loss: 0.3580 - accuracy: 0.8227
Epoch 296/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3579 - accuracy: 0.8169
Epoch 297/300
6/6 [==============================] - 0s 639us/step - loss: 0.3576 - accuracy: 0.8169
Epoch 298/300
6/6 [==============================] - 0s 608us/step - loss: 0.3575 - accuracy: 0.8169
Epoch 299/300
6/6 [==============================] - 0s 592us/step - loss: 0.3573 - accuracy: 0.8169
Epoch 300/300
6/6 [==============================] - 0s 615us/step - loss: 0.3570 - accuracy: 0.8169
Epoch 1/300
6/6 [==============================] - 0s 774us/step - loss: 0.6586 - accuracy: 0.6686
Epoch 2/300
6/6 [==============================] - 0s 13ms/step - loss: 0.6453 - accuracy: 0.6715
Epoch 3/300
6/6 [==============================] - 0s 651us/step - loss: 0.6335 - accuracy: 0.6860
Epoch 4/300
6/6 [==============================] - 0s 628us/step - loss: 0.6229 - accuracy: 0.6890
Epoch 5/300
6/6 [==============================] - 0s 14ms/step - loss: 0.6117 - accuracy: 0.6919
Epoch 6/300
6/6 [==============================] - 0s 664us/step - loss: 0.6019 - accuracy: 0.6977
Epoch 7/300
6/6 [==============================] - 0s 688us/step - loss: 0.5927 - accuracy: 0.7064
Epoch 8/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5838 - accuracy: 0.7151
Epoch 9/300
6/6 [==============================] - 0s 676us/step - loss: 0.5762 - accuracy: 0.7209
Epoch 10/300
6/6 [==============================] - 0s 690us/step - loss: 0.5686 - accuracy: 0.7180
Epoch 11/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5617 - accuracy: 0.7151
Epoch 12/300
6/6 [==============================] - 0s 584us/step - loss: 0.5549 - accuracy: 0.7180
Epoch 13/300
6/6 [==============================] - 0s 654us/step - loss: 0.5487 - accuracy: 0.7238
Epoch 14/300
6/6 [==============================] - 0s 619us/step - loss: 0.5427 - accuracy: 0.7267
Epoch 15/300
6/6 [==============================] - 0s 655us/step - loss: 0.5369 - accuracy: 0.7326
Epoch 16/300
6/6 [==============================] - 0s 665us/step - loss: 0.5317 - accuracy: 0.7384
Epoch 17/300
6/6 [==============================] - 0s 627us/step - loss: 0.5262 - accuracy: 0.7413
Epoch 18/300
6/6 [==============================] - 0s 648us/step - loss: 0.5217 - accuracy: 0.7500
Epoch 19/300
6/6 [==============================] - 0s 616us/step - loss: 0.5169 - accuracy: 0.7529
Epoch 20/300
6/6 [==============================] - 0s 556us/step - loss: 0.5123 - accuracy: 0.7471
Epoch 21/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5080 - accuracy: 0.7500
Epoch 22/300
6/6 [==============================] - 0s 584us/step - loss: 0.5036 - accuracy: 0.7645
Epoch 23/300
6/6 [==============================] - 0s 545us/step - loss: 0.4998 - accuracy: 0.7645
Epoch 24/300
6/6 [==============================] - 0s 568us/step - loss: 0.4960 - accuracy: 0.7674
Epoch 25/300
6/6 [==============================] - 0s 570us/step - loss: 0.4924 - accuracy: 0.7645
Epoch 26/300
6/6 [==============================] - 0s 575us/step - loss: 0.4892 - accuracy: 0.7703
Epoch 27/300
6/6 [==============================] - 0s 580us/step - loss: 0.4860 - accuracy: 0.7733
Epoch 28/300
6/6 [==============================] - 0s 592us/step - loss: 0.4831 - accuracy: 0.7820
Epoch 29/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4804 - accuracy: 0.7820
Epoch 30/300
6/6 [==============================] - 0s 600us/step - loss: 0.4778 - accuracy: 0.7820
Epoch 31/300
6/6 [==============================] - 0s 566us/step - loss: 0.4755 - accuracy: 0.7820
Epoch 32/300
6/6 [==============================] - 0s 593us/step - loss: 0.4729 - accuracy: 0.7849
Epoch 33/300
6/6 [==============================] - 0s 585us/step - loss: 0.4707 - accuracy: 0.7878
Epoch 34/300
6/6 [==============================] - 0s 569us/step - loss: 0.4687 - accuracy: 0.7849
Epoch 35/300
6/6 [==============================] - 0s 550us/step - loss: 0.4665 - accuracy: 0.7849
Epoch 36/300
6/6 [==============================] - 0s 570us/step - loss: 0.4646 - accuracy: 0.7849
Epoch 37/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4624 - accuracy: 0.7878
Epoch 38/300
6/6 [==============================] - 0s 574us/step - loss: 0.4608 - accuracy: 0.7907
Epoch 39/300
6/6 [==============================] - 0s 559us/step - loss: 0.4588 - accuracy: 0.7936
Epoch 40/300
6/6 [==============================] - 0s 548us/step - loss: 0.4571 - accuracy: 0.7936
Epoch 41/300
6/6 [==============================] - 0s 544us/step - loss: 0.4555 - accuracy: 0.7936
Epoch 42/300
6/6 [==============================] - 0s 562us/step - loss: 0.4537 - accuracy: 0.7965
Epoch 43/300
6/6 [==============================] - 0s 556us/step - loss: 0.4521 - accuracy: 0.8023
Epoch 44/300
6/6 [==============================] - 0s 550us/step - loss: 0.4505 - accuracy: 0.8052
Epoch 45/300
6/6 [==============================] - 0s 544us/step - loss: 0.4490 - accuracy: 0.8052
Epoch 46/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4476 - accuracy: 0.8023
Epoch 47/300
6/6 [==============================] - 0s 566us/step - loss: 0.4461 - accuracy: 0.7994
Epoch 48/300
6/6 [==============================] - 0s 537us/step - loss: 0.4448 - accuracy: 0.7994
Epoch 49/300
6/6 [==============================] - 0s 541us/step - loss: 0.4437 - accuracy: 0.8023
Epoch 50/300
6/6 [==============================] - 0s 538us/step - loss: 0.4425 - accuracy: 0.8023
Epoch 51/300
6/6 [==============================] - 0s 563us/step - loss: 0.4413 - accuracy: 0.8052
Epoch 52/300
6/6 [==============================] - 0s 580us/step - loss: 0.4403 - accuracy: 0.8052
Epoch 53/300
6/6 [==============================] - 0s 549us/step - loss: 0.4393 - accuracy: 0.8052
Epoch 54/300
6/6 [==============================] - 0s 561us/step - loss: 0.4379 - accuracy: 0.8081
Epoch 55/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4372 - accuracy: 0.8110
Epoch 56/300
6/6 [==============================] - 0s 555us/step - loss: 0.4357 - accuracy: 0.8081
Epoch 57/300
6/6 [==============================] - 0s 575us/step - loss: 0.4347 - accuracy: 0.8081
Epoch 58/300
6/6 [==============================] - 0s 556us/step - loss: 0.4336 - accuracy: 0.8081
Epoch 59/300
6/6 [==============================] - 0s 581us/step - loss: 0.4325 - accuracy: 0.8052
Epoch 60/300
6/6 [==============================] - 0s 608us/step - loss: 0.4315 - accuracy: 0.8081
Epoch 61/300
6/6 [==============================] - 0s 568us/step - loss: 0.4305 - accuracy: 0.8081
Epoch 62/300
6/6 [==============================] - 0s 561us/step - loss: 0.4297 - accuracy: 0.8110
Epoch 63/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4286 - accuracy: 0.8110
Epoch 64/300
6/6 [==============================] - 0s 581us/step - loss: 0.4276 - accuracy: 0.8140
Epoch 65/300
6/6 [==============================] - 0s 569us/step - loss: 0.4266 - accuracy: 0.8169
Epoch 66/300
6/6 [==============================] - 0s 580us/step - loss: 0.4255 - accuracy: 0.8169
Epoch 67/300
6/6 [==============================] - 0s 544us/step - loss: 0.4246 - accuracy: 0.8140
Epoch 68/300
6/6 [==============================] - 0s 605us/step - loss: 0.4237 - accuracy: 0.8140
Epoch 69/300
6/6 [==============================] - 0s 592us/step - loss: 0.4228 - accuracy: 0.8140
Epoch 70/300
6/6 [==============================] - 0s 575us/step - loss: 0.4218 - accuracy: 0.8110
Epoch 71/300
6/6 [==============================] - 0s 563us/step - loss: 0.4213 - accuracy: 0.8110
Epoch 72/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4204 - accuracy: 0.8052
Epoch 73/300
6/6 [==============================] - 0s 571us/step - loss: 0.4195 - accuracy: 0.8052
Epoch 74/300
6/6 [==============================] - 0s 569us/step - loss: 0.4188 - accuracy: 0.8052
Epoch 75/300
6/6 [==============================] - 0s 582us/step - loss: 0.4182 - accuracy: 0.8110
Epoch 76/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4173 - accuracy: 0.8110
Epoch 77/300
6/6 [==============================] - 0s 575us/step - loss: 0.4168 - accuracy: 0.8110
Epoch 78/300
6/6 [==============================] - 0s 590us/step - loss: 0.4158 - accuracy: 0.8110
Epoch 79/300
6/6 [==============================] - 0s 580us/step - loss: 0.4150 - accuracy: 0.8052
Epoch 80/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4144 - accuracy: 0.8023
Epoch 81/300
6/6 [==============================] - 0s 601us/step - loss: 0.4136 - accuracy: 0.8052
Epoch 82/300
6/6 [==============================] - 0s 595us/step - loss: 0.4130 - accuracy: 0.8052
Epoch 83/300
6/6 [==============================] - 0s 555us/step - loss: 0.4124 - accuracy: 0.8081
Epoch 84/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4120 - accuracy: 0.8081
Epoch 85/300
6/6 [==============================] - 0s 592us/step - loss: 0.4112 - accuracy: 0.8081
Epoch 86/300
6/6 [==============================] - 0s 602us/step - loss: 0.4107 - accuracy: 0.8081
Epoch 87/300
6/6 [==============================] - 0s 623us/step - loss: 0.4100 - accuracy: 0.8081
Epoch 88/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4094 - accuracy: 0.8081
Epoch 89/300
6/6 [==============================] - 0s 583us/step - loss: 0.4088 - accuracy: 0.8110
Epoch 90/300
6/6 [==============================] - 0s 567us/step - loss: 0.4083 - accuracy: 0.8110
Epoch 91/300
6/6 [==============================] - 0s 548us/step - loss: 0.4075 - accuracy: 0.8110
Epoch 92/300
6/6 [==============================] - 0s 562us/step - loss: 0.4069 - accuracy: 0.8110
Epoch 93/300
6/6 [==============================] - 0s 619us/step - loss: 0.4066 - accuracy: 0.8110
Epoch 94/300
6/6 [==============================] - 0s 580us/step - loss: 0.4058 - accuracy: 0.8110
Epoch 95/300
6/6 [==============================] - 0s 560us/step - loss: 0.4053 - accuracy: 0.8081
Epoch 96/300
6/6 [==============================] - 0s 572us/step - loss: 0.4048 - accuracy: 0.8081
Epoch 97/300
6/6 [==============================] - 0s 595us/step - loss: 0.4042 - accuracy: 0.8052
Epoch 98/300
6/6 [==============================] - 0s 585us/step - loss: 0.4038 - accuracy: 0.8052
Epoch 99/300
6/6 [==============================] - 0s 598us/step - loss: 0.4031 - accuracy: 0.8052
Epoch 100/300
6/6 [==============================] - 0s 580us/step - loss: 0.4026 - accuracy: 0.8081
Epoch 101/300
6/6 [==============================] - 0s 580us/step - loss: 0.4022 - accuracy: 0.8110
Epoch 102/300
6/6 [==============================] - 0s 616us/step - loss: 0.4018 - accuracy: 0.8110
Epoch 103/300
6/6 [==============================] - 0s 564us/step - loss: 0.4013 - accuracy: 0.8110
Epoch 104/300
6/6 [==============================] - 0s 585us/step - loss: 0.4009 - accuracy: 0.8110
Epoch 105/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4006 - accuracy: 0.8110
Epoch 106/300
6/6 [==============================] - 0s 547us/step - loss: 0.3999 - accuracy: 0.8081
Epoch 107/300
6/6 [==============================] - 0s 571us/step - loss: 0.3994 - accuracy: 0.8081
Epoch 108/300
6/6 [==============================] - 0s 586us/step - loss: 0.3989 - accuracy: 0.8081
Epoch 109/300
6/6 [==============================] - 0s 584us/step - loss: 0.3986 - accuracy: 0.8081
Epoch 110/300
6/6 [==============================] - 0s 599us/step - loss: 0.3981 - accuracy: 0.8081
Epoch 111/300
6/6 [==============================] - 0s 563us/step - loss: 0.3978 - accuracy: 0.8110
Epoch 112/300
6/6 [==============================] - 0s 552us/step - loss: 0.3975 - accuracy: 0.8140
Epoch 113/300
6/6 [==============================] - 0s 538us/step - loss: 0.3971 - accuracy: 0.8140
Epoch 114/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3968 - accuracy: 0.8140
Epoch 115/300
6/6 [==============================] - 0s 561us/step - loss: 0.3966 - accuracy: 0.8140
Epoch 116/300
6/6 [==============================] - 0s 551us/step - loss: 0.3961 - accuracy: 0.8140
Epoch 117/300
6/6 [==============================] - 0s 552us/step - loss: 0.3956 - accuracy: 0.8169
Epoch 118/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3952 - accuracy: 0.8169
Epoch 119/300
6/6 [==============================] - 0s 569us/step - loss: 0.3947 - accuracy: 0.8169
Epoch 120/300
6/6 [==============================] - 0s 562us/step - loss: 0.3941 - accuracy: 0.8169
Epoch 121/300
6/6 [==============================] - 0s 558us/step - loss: 0.3938 - accuracy: 0.8169
Epoch 122/300
6/6 [==============================] - 0s 567us/step - loss: 0.3935 - accuracy: 0.8169
Epoch 123/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3930 - accuracy: 0.8169
Epoch 124/300
6/6 [==============================] - 0s 561us/step - loss: 0.3925 - accuracy: 0.8140
Epoch 125/300
6/6 [==============================] - 0s 549us/step - loss: 0.3921 - accuracy: 0.8169
Epoch 126/300
6/6 [==============================] - 0s 575us/step - loss: 0.3917 - accuracy: 0.8198
Epoch 127/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3915 - accuracy: 0.8198
Epoch 128/300
6/6 [==============================] - 0s 555us/step - loss: 0.3911 - accuracy: 0.8198
Epoch 129/300
6/6 [==============================] - 0s 541us/step - loss: 0.3907 - accuracy: 0.8198
Epoch 130/300
6/6 [==============================] - 0s 555us/step - loss: 0.3904 - accuracy: 0.8198
Epoch 131/300
6/6 [==============================] - 0s 542us/step - loss: 0.3902 - accuracy: 0.8198
Epoch 132/300
6/6 [==============================] - 0s 566us/step - loss: 0.3900 - accuracy: 0.8198
Epoch 133/300
6/6 [==============================] - 0s 553us/step - loss: 0.3896 - accuracy: 0.8198
Epoch 134/300
6/6 [==============================] - 0s 561us/step - loss: 0.3890 - accuracy: 0.8198
Epoch 135/300
6/6 [==============================] - 0s 577us/step - loss: 0.3888 - accuracy: 0.8198
Epoch 136/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3882 - accuracy: 0.8198
Epoch 137/300
6/6 [==============================] - 0s 558us/step - loss: 0.3882 - accuracy: 0.8198
Epoch 138/300
6/6 [==============================] - 0s 542us/step - loss: 0.3877 - accuracy: 0.8227
Epoch 139/300
6/6 [==============================] - 0s 555us/step - loss: 0.3875 - accuracy: 0.8198
Epoch 140/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3871 - accuracy: 0.8198
Epoch 141/300
6/6 [==============================] - 0s 590us/step - loss: 0.3869 - accuracy: 0.8198
Epoch 142/300
6/6 [==============================] - 0s 585us/step - loss: 0.3868 - accuracy: 0.8198
Epoch 143/300
6/6 [==============================] - 0s 582us/step - loss: 0.3865 - accuracy: 0.8198
Epoch 144/300
6/6 [==============================] - 0s 557us/step - loss: 0.3862 - accuracy: 0.8198
Epoch 145/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3861 - accuracy: 0.8198
Epoch 146/300
6/6 [==============================] - 0s 593us/step - loss: 0.3858 - accuracy: 0.8198
Epoch 147/300
6/6 [==============================] - 0s 588us/step - loss: 0.3855 - accuracy: 0.8198
Epoch 148/300
6/6 [==============================] - 0s 579us/step - loss: 0.3857 - accuracy: 0.8198
Epoch 149/300
6/6 [==============================] - 0s 581us/step - loss: 0.3850 - accuracy: 0.8227
Epoch 150/300
6/6 [==============================] - 0s 576us/step - loss: 0.3848 - accuracy: 0.8227
Epoch 151/300
6/6 [==============================] - 0s 576us/step - loss: 0.3847 - accuracy: 0.8227
Epoch 152/300
6/6 [==============================] - 0s 563us/step - loss: 0.3843 - accuracy: 0.8256
Epoch 153/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3842 - accuracy: 0.8256
Epoch 154/300
6/6 [==============================] - 0s 568us/step - loss: 0.3838 - accuracy: 0.8227
Epoch 155/300
6/6 [==============================] - 0s 599us/step - loss: 0.3837 - accuracy: 0.8227
Epoch 156/300
6/6 [==============================] - 0s 563us/step - loss: 0.3835 - accuracy: 0.8227
Epoch 157/300
6/6 [==============================] - 0s 569us/step - loss: 0.3833 - accuracy: 0.8198
Epoch 158/300
6/6 [==============================] - 0s 564us/step - loss: 0.3833 - accuracy: 0.8198
Epoch 159/300
6/6 [==============================] - 0s 571us/step - loss: 0.3830 - accuracy: 0.8198
Epoch 160/300
6/6 [==============================] - 0s 558us/step - loss: 0.3829 - accuracy: 0.8198
Epoch 161/300
6/6 [==============================] - 0s 557us/step - loss: 0.3826 - accuracy: 0.8198
Epoch 162/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3825 - accuracy: 0.8227
Epoch 163/300
6/6 [==============================] - 0s 564us/step - loss: 0.3821 - accuracy: 0.8285
Epoch 164/300
6/6 [==============================] - 0s 564us/step - loss: 0.3820 - accuracy: 0.8256
Epoch 165/300
6/6 [==============================] - 0s 560us/step - loss: 0.3818 - accuracy: 0.8256
Epoch 166/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3816 - accuracy: 0.8256
Epoch 167/300
6/6 [==============================] - 0s 571us/step - loss: 0.3814 - accuracy: 0.8256
Epoch 168/300
6/6 [==============================] - 0s 552us/step - loss: 0.3814 - accuracy: 0.8227
Epoch 169/300
6/6 [==============================] - 0s 543us/step - loss: 0.3810 - accuracy: 0.8227
Epoch 170/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3808 - accuracy: 0.8227
Epoch 171/300
6/6 [==============================] - 0s 551us/step - loss: 0.3806 - accuracy: 0.8198
Epoch 172/300
6/6 [==============================] - 0s 538us/step - loss: 0.3805 - accuracy: 0.8227
Epoch 173/300
6/6 [==============================] - 0s 551us/step - loss: 0.3804 - accuracy: 0.8227
Epoch 174/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3801 - accuracy: 0.8198
Epoch 175/300
6/6 [==============================] - 0s 580us/step - loss: 0.3800 - accuracy: 0.8198
Epoch 176/300
6/6 [==============================] - 0s 554us/step - loss: 0.3798 - accuracy: 0.8227
Epoch 177/300
6/6 [==============================] - 0s 549us/step - loss: 0.3797 - accuracy: 0.8198
Epoch 178/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3794 - accuracy: 0.8227
Epoch 179/300
6/6 [==============================] - 0s 570us/step - loss: 0.3793 - accuracy: 0.8227
Epoch 180/300
6/6 [==============================] - 0s 570us/step - loss: 0.3792 - accuracy: 0.8227
Epoch 181/300
6/6 [==============================] - 0s 533us/step - loss: 0.3789 - accuracy: 0.8227
Epoch 182/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3787 - accuracy: 0.8198
Epoch 183/300
6/6 [==============================] - 0s 579us/step - loss: 0.3786 - accuracy: 0.8198
Epoch 184/300
6/6 [==============================] - 0s 568us/step - loss: 0.3787 - accuracy: 0.8198
Epoch 185/300
6/6 [==============================] - 0s 566us/step - loss: 0.3784 - accuracy: 0.8198
Epoch 186/300
6/6 [==============================] - 0s 570us/step - loss: 0.3785 - accuracy: 0.8198
Epoch 187/300
6/6 [==============================] - 0s 564us/step - loss: 0.3781 - accuracy: 0.8198
Epoch 188/300
6/6 [==============================] - 0s 542us/step - loss: 0.3780 - accuracy: 0.8198
Epoch 189/300
6/6 [==============================] - 0s 576us/step - loss: 0.3778 - accuracy: 0.8198
Epoch 190/300
6/6 [==============================] - 0s 563us/step - loss: 0.3776 - accuracy: 0.8198
Epoch 191/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3774 - accuracy: 0.8198
Epoch 192/300
6/6 [==============================] - 0s 536us/step - loss: 0.3773 - accuracy: 0.8169
Epoch 193/300
6/6 [==============================] - 0s 549us/step - loss: 0.3773 - accuracy: 0.8169
Epoch 194/300
6/6 [==============================] - 0s 560us/step - loss: 0.3770 - accuracy: 0.8198
Epoch 195/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3769 - accuracy: 0.8169
Epoch 196/300
6/6 [==============================] - 0s 555us/step - loss: 0.3769 - accuracy: 0.8169
Epoch 197/300
6/6 [==============================] - 0s 563us/step - loss: 0.3766 - accuracy: 0.8140
Epoch 198/300
6/6 [==============================] - 0s 544us/step - loss: 0.3764 - accuracy: 0.8169
Epoch 199/300
6/6 [==============================] - 0s 529us/step - loss: 0.3764 - accuracy: 0.8169
Epoch 200/300
6/6 [==============================] - 0s 566us/step - loss: 0.3764 - accuracy: 0.8169
Epoch 201/300
6/6 [==============================] - 0s 539us/step - loss: 0.3762 - accuracy: 0.8169
Epoch 202/300
6/6 [==============================] - 0s 594us/step - loss: 0.3761 - accuracy: 0.8169
Epoch 203/300
6/6 [==============================] - 0s 547us/step - loss: 0.3761 - accuracy: 0.8198
Epoch 204/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3758 - accuracy: 0.8169
Epoch 205/300
6/6 [==============================] - 0s 559us/step - loss: 0.3757 - accuracy: 0.8169
Epoch 206/300
6/6 [==============================] - 0s 536us/step - loss: 0.3755 - accuracy: 0.8198
Epoch 207/300
6/6 [==============================] - 0s 529us/step - loss: 0.3753 - accuracy: 0.8198
Epoch 208/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3753 - accuracy: 0.8198
Epoch 209/300
6/6 [==============================] - 0s 545us/step - loss: 0.3750 - accuracy: 0.8169
Epoch 210/300
6/6 [==============================] - 0s 538us/step - loss: 0.3748 - accuracy: 0.8169
Epoch 211/300
6/6 [==============================] - 0s 548us/step - loss: 0.3748 - accuracy: 0.8198
Epoch 212/300
6/6 [==============================] - 0s 557us/step - loss: 0.3751 - accuracy: 0.8198
Epoch 213/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3746 - accuracy: 0.8198
Epoch 214/300
6/6 [==============================] - 0s 547us/step - loss: 0.3745 - accuracy: 0.8198
Epoch 215/300
6/6 [==============================] - 0s 560us/step - loss: 0.3742 - accuracy: 0.8198
Epoch 216/300
6/6 [==============================] - 0s 546us/step - loss: 0.3742 - accuracy: 0.8169
Epoch 217/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3740 - accuracy: 0.8169
Epoch 218/300
6/6 [==============================] - 0s 585us/step - loss: 0.3738 - accuracy: 0.8169
Epoch 219/300
6/6 [==============================] - 0s 563us/step - loss: 0.3738 - accuracy: 0.8198
Epoch 220/300
6/6 [==============================] - 0s 574us/step - loss: 0.3735 - accuracy: 0.8198
Epoch 221/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3735 - accuracy: 0.8198
Epoch 222/300
6/6 [==============================] - 0s 583us/step - loss: 0.3733 - accuracy: 0.8169
Epoch 223/300
6/6 [==============================] - 0s 571us/step - loss: 0.3731 - accuracy: 0.8169
Epoch 224/300
6/6 [==============================] - 0s 569us/step - loss: 0.3731 - accuracy: 0.8169
Epoch 225/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3730 - accuracy: 0.8169
Epoch 226/300
6/6 [==============================] - 0s 575us/step - loss: 0.3731 - accuracy: 0.8169
Epoch 227/300
6/6 [==============================] - 0s 558us/step - loss: 0.3726 - accuracy: 0.8198
Epoch 228/300
6/6 [==============================] - 0s 542us/step - loss: 0.3727 - accuracy: 0.8169
Epoch 229/300
6/6 [==============================] - 0s 537us/step - loss: 0.3725 - accuracy: 0.8169
Epoch 230/300
6/6 [==============================] - 0s 568us/step - loss: 0.3722 - accuracy: 0.8169
Epoch 231/300
6/6 [==============================] - 0s 557us/step - loss: 0.3722 - accuracy: 0.8169
Epoch 232/300
6/6 [==============================] - 0s 562us/step - loss: 0.3721 - accuracy: 0.8169
Epoch 233/300
6/6 [==============================] - 0s 576us/step - loss: 0.3719 - accuracy: 0.8169
Epoch 234/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3717 - accuracy: 0.8198
Epoch 235/300
6/6 [==============================] - 0s 571us/step - loss: 0.3715 - accuracy: 0.8227
Epoch 236/300
6/6 [==============================] - 0s 547us/step - loss: 0.3713 - accuracy: 0.8256
Epoch 237/300
6/6 [==============================] - 0s 561us/step - loss: 0.3712 - accuracy: 0.8256
Epoch 238/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3710 - accuracy: 0.8256
Epoch 239/300
6/6 [==============================] - 0s 591us/step - loss: 0.3708 - accuracy: 0.8256
Epoch 240/300
6/6 [==============================] - 0s 549us/step - loss: 0.3707 - accuracy: 0.8256
Epoch 241/300
6/6 [==============================] - 0s 561us/step - loss: 0.3706 - accuracy: 0.8256
Epoch 242/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3706 - accuracy: 0.8256
Epoch 243/300
6/6 [==============================] - 0s 629us/step - loss: 0.3706 - accuracy: 0.8285
Epoch 244/300
6/6 [==============================] - 0s 582us/step - loss: 0.3704 - accuracy: 0.8256
Epoch 245/300
6/6 [==============================] - 0s 567us/step - loss: 0.3703 - accuracy: 0.8256
Epoch 246/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3702 - accuracy: 0.8285
Epoch 247/300
6/6 [==============================] - 0s 573us/step - loss: 0.3700 - accuracy: 0.8256
Epoch 248/300
6/6 [==============================] - 0s 553us/step - loss: 0.3699 - accuracy: 0.8256
Epoch 249/300
6/6 [==============================] - 0s 541us/step - loss: 0.3696 - accuracy: 0.8256
Epoch 250/300
6/6 [==============================] - 0s 559us/step - loss: 0.3698 - accuracy: 0.8256
Epoch 251/300
6/6 [==============================] - 0s 563us/step - loss: 0.3696 - accuracy: 0.8227
Epoch 252/300
6/6 [==============================] - 0s 564us/step - loss: 0.3694 - accuracy: 0.8227
Epoch 253/300
6/6 [==============================] - 0s 549us/step - loss: 0.3692 - accuracy: 0.8227
Epoch 254/300
6/6 [==============================] - 0s 567us/step - loss: 0.3691 - accuracy: 0.8227
Epoch 255/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3690 - accuracy: 0.8227
Epoch 256/300
6/6 [==============================] - 0s 565us/step - loss: 0.3689 - accuracy: 0.8227
Epoch 257/300
6/6 [==============================] - 0s 584us/step - loss: 0.3689 - accuracy: 0.8227
Epoch 258/300
6/6 [==============================] - 0s 539us/step - loss: 0.3688 - accuracy: 0.8227
Epoch 259/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3686 - accuracy: 0.8227
Epoch 260/300
6/6 [==============================] - 0s 582us/step - loss: 0.3685 - accuracy: 0.8227
Epoch 261/300
6/6 [==============================] - 0s 553us/step - loss: 0.3686 - accuracy: 0.8227
Epoch 262/300
6/6 [==============================] - 0s 574us/step - loss: 0.3683 - accuracy: 0.8227
Epoch 263/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3683 - accuracy: 0.8256
Epoch 264/300
6/6 [==============================] - 0s 564us/step - loss: 0.3684 - accuracy: 0.8256
Epoch 265/300
6/6 [==============================] - 0s 548us/step - loss: 0.3681 - accuracy: 0.8256
Epoch 266/300
6/6 [==============================] - 0s 561us/step - loss: 0.3682 - accuracy: 0.8256
Epoch 267/300
6/6 [==============================] - 0s 556us/step - loss: 0.3680 - accuracy: 0.8227
Epoch 268/300
6/6 [==============================] - 0s 588us/step - loss: 0.3678 - accuracy: 0.8227
Epoch 269/300
6/6 [==============================] - 0s 558us/step - loss: 0.3678 - accuracy: 0.8227
Epoch 270/300
6/6 [==============================] - 0s 569us/step - loss: 0.3676 - accuracy: 0.8256
Epoch 271/300
6/6 [==============================] - 0s 549us/step - loss: 0.3674 - accuracy: 0.8256
Epoch 272/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3674 - accuracy: 0.8256
Epoch 273/300
6/6 [==============================] - 0s 562us/step - loss: 0.3673 - accuracy: 0.8285
Epoch 274/300
6/6 [==============================] - 0s 545us/step - loss: 0.3675 - accuracy: 0.8256
Epoch 275/300
6/6 [==============================] - 0s 557us/step - loss: 0.3673 - accuracy: 0.8256
Epoch 276/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3671 - accuracy: 0.8256
Epoch 277/300
6/6 [==============================] - 0s 550us/step - loss: 0.3669 - accuracy: 0.8256
Epoch 278/300
6/6 [==============================] - 0s 563us/step - loss: 0.3671 - accuracy: 0.8256
Epoch 279/300
6/6 [==============================] - 0s 547us/step - loss: 0.3669 - accuracy: 0.8256
Epoch 280/300
6/6 [==============================] - 0s 554us/step - loss: 0.3667 - accuracy: 0.8256
Epoch 281/300
6/6 [==============================] - 0s 569us/step - loss: 0.3666 - accuracy: 0.8256
Epoch 282/300
6/6 [==============================] - 0s 557us/step - loss: 0.3666 - accuracy: 0.8256
Epoch 283/300
6/6 [==============================] - 0s 554us/step - loss: 0.3665 - accuracy: 0.8256
Epoch 284/300
6/6 [==============================] - 0s 531us/step - loss: 0.3666 - accuracy: 0.8256
Epoch 285/300
6/6 [==============================] - 0s 551us/step - loss: 0.3661 - accuracy: 0.8256
Epoch 286/300
6/6 [==============================] - 0s 587us/step - loss: 0.3662 - accuracy: 0.8285
Epoch 287/300
6/6 [==============================] - 0s 573us/step - loss: 0.3660 - accuracy: 0.8256
Epoch 288/300
6/6 [==============================] - 0s 616us/step - loss: 0.3660 - accuracy: 0.8256
Epoch 289/300
6/6 [==============================] - 0s 570us/step - loss: 0.3658 - accuracy: 0.8256
Epoch 290/300
6/6 [==============================] - 0s 564us/step - loss: 0.3658 - accuracy: 0.8227
Epoch 291/300
6/6 [==============================] - 0s 550us/step - loss: 0.3658 - accuracy: 0.8227
Epoch 292/300
6/6 [==============================] - 0s 544us/step - loss: 0.3656 - accuracy: 0.8256
Epoch 293/300
6/6 [==============================] - 0s 548us/step - loss: 0.3657 - accuracy: 0.8256
Epoch 294/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3655 - accuracy: 0.8285
Epoch 295/300
6/6 [==============================] - 0s 551us/step - loss: 0.3653 - accuracy: 0.8256
Epoch 296/300
6/6 [==============================] - 0s 538us/step - loss: 0.3654 - accuracy: 0.8256
Epoch 297/300
6/6 [==============================] - 0s 538us/step - loss: 0.3652 - accuracy: 0.8285
Epoch 298/300
6/6 [==============================] - 0s 541us/step - loss: 0.3651 - accuracy: 0.8285
Epoch 299/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3651 - accuracy: 0.8227
Epoch 300/300
6/6 [==============================] - 0s 559us/step - loss: 0.3651 - accuracy: 0.8227
Epoch 1/300
6/6 [==============================] - 0s 706us/step - loss: 0.6377 - accuracy: 0.6899
Epoch 2/300
6/6 [==============================] - 0s 575us/step - loss: 0.6249 - accuracy: 0.6957
Epoch 3/300
6/6 [==============================] - 0s 15ms/step - loss: 0.6131 - accuracy: 0.7130
Epoch 4/300
6/6 [==============================] - 0s 581us/step - loss: 0.6017 - accuracy: 0.7217
Epoch 5/300
6/6 [==============================] - 0s 561us/step - loss: 0.5910 - accuracy: 0.7217
Epoch 6/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5810 - accuracy: 0.7391
Epoch 7/300
6/6 [==============================] - 0s 620us/step - loss: 0.5712 - accuracy: 0.7333
Epoch 8/300
6/6 [==============================] - 0s 660us/step - loss: 0.5620 - accuracy: 0.7362
Epoch 9/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5535 - accuracy: 0.7391
Epoch 10/300
6/6 [==============================] - 0s 655us/step - loss: 0.5460 - accuracy: 0.7449
Epoch 11/300
6/6 [==============================] - 0s 622us/step - loss: 0.5382 - accuracy: 0.7449
Epoch 12/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5317 - accuracy: 0.7449
Epoch 13/300
6/6 [==============================] - 0s 592us/step - loss: 0.5257 - accuracy: 0.7449
Epoch 14/300
6/6 [==============================] - 0s 573us/step - loss: 0.5197 - accuracy: 0.7478
Epoch 15/300
6/6 [==============================] - 0s 15ms/step - loss: 0.5144 - accuracy: 0.7507
Epoch 16/300
6/6 [==============================] - 0s 578us/step - loss: 0.5093 - accuracy: 0.7565
Epoch 17/300
6/6 [==============================] - 0s 559us/step - loss: 0.5046 - accuracy: 0.7623
Epoch 18/300
6/6 [==============================] - 0s 546us/step - loss: 0.4999 - accuracy: 0.7652
Epoch 19/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4955 - accuracy: 0.7681
Epoch 20/300
6/6 [==============================] - 0s 551us/step - loss: 0.4916 - accuracy: 0.7710
Epoch 21/300
6/6 [==============================] - 0s 567us/step - loss: 0.4878 - accuracy: 0.7739
Epoch 22/300
6/6 [==============================] - 0s 608us/step - loss: 0.4840 - accuracy: 0.7710
Epoch 23/300
6/6 [==============================] - 0s 623us/step - loss: 0.4807 - accuracy: 0.7710
Epoch 24/300
6/6 [==============================] - 0s 593us/step - loss: 0.4776 - accuracy: 0.7739
Epoch 25/300
6/6 [==============================] - 0s 591us/step - loss: 0.4744 - accuracy: 0.7739
Epoch 26/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4717 - accuracy: 0.7768
Epoch 27/300
6/6 [==============================] - 0s 577us/step - loss: 0.4691 - accuracy: 0.7768
Epoch 28/300
6/6 [==============================] - 0s 577us/step - loss: 0.4667 - accuracy: 0.7797
Epoch 29/300
6/6 [==============================] - 0s 580us/step - loss: 0.4645 - accuracy: 0.7826
Epoch 30/300
6/6 [==============================] - 0s 580us/step - loss: 0.4622 - accuracy: 0.7855
Epoch 31/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4603 - accuracy: 0.7884
Epoch 32/300
6/6 [==============================] - 0s 596us/step - loss: 0.4582 - accuracy: 0.7884
Epoch 33/300
6/6 [==============================] - 0s 588us/step - loss: 0.4566 - accuracy: 0.7855
Epoch 34/300
6/6 [==============================] - 0s 600us/step - loss: 0.4546 - accuracy: 0.7826
Epoch 35/300
6/6 [==============================] - 0s 623us/step - loss: 0.4528 - accuracy: 0.7826
Epoch 36/300
6/6 [==============================] - 0s 593us/step - loss: 0.4512 - accuracy: 0.7826
Epoch 37/300
6/6 [==============================] - 0s 577us/step - loss: 0.4496 - accuracy: 0.7913
Epoch 38/300
6/6 [==============================] - 0s 586us/step - loss: 0.4482 - accuracy: 0.7913
Epoch 39/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4467 - accuracy: 0.7942
Epoch 40/300
6/6 [==============================] - 0s 565us/step - loss: 0.4453 - accuracy: 0.7942
Epoch 41/300
6/6 [==============================] - 0s 551us/step - loss: 0.4440 - accuracy: 0.7971
Epoch 42/300
6/6 [==============================] - 0s 584us/step - loss: 0.4427 - accuracy: 0.7971
Epoch 43/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4417 - accuracy: 0.7942
Epoch 44/300
6/6 [==============================] - 0s 601us/step - loss: 0.4402 - accuracy: 0.7971
Epoch 45/300
6/6 [==============================] - 0s 580us/step - loss: 0.4389 - accuracy: 0.7971
Epoch 46/300
6/6 [==============================] - 0s 569us/step - loss: 0.4377 - accuracy: 0.7971
Epoch 47/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4362 - accuracy: 0.8058
Epoch 48/300
6/6 [==============================] - 0s 566us/step - loss: 0.4351 - accuracy: 0.8087
Epoch 49/300
6/6 [==============================] - 0s 548us/step - loss: 0.4339 - accuracy: 0.8087
Epoch 50/300
6/6 [==============================] - 0s 576us/step - loss: 0.4328 - accuracy: 0.8087
Epoch 51/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4315 - accuracy: 0.8145
Epoch 52/300
6/6 [==============================] - 0s 608us/step - loss: 0.4303 - accuracy: 0.8145
Epoch 53/300
6/6 [==============================] - 0s 594us/step - loss: 0.4291 - accuracy: 0.8116
Epoch 54/300
6/6 [==============================] - 0s 578us/step - loss: 0.4281 - accuracy: 0.8116
Epoch 55/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4268 - accuracy: 0.8116
Epoch 56/300
6/6 [==============================] - 0s 554us/step - loss: 0.4259 - accuracy: 0.8145
Epoch 57/300
6/6 [==============================] - 0s 555us/step - loss: 0.4248 - accuracy: 0.8174
Epoch 58/300
6/6 [==============================] - 0s 545us/step - loss: 0.4239 - accuracy: 0.8174
Epoch 59/300
6/6 [==============================] - 0s 664us/step - loss: 0.4229 - accuracy: 0.8203
Epoch 60/300
6/6 [==============================] - 0s 558us/step - loss: 0.4219 - accuracy: 0.8203
Epoch 61/300
6/6 [==============================] - 0s 548us/step - loss: 0.4211 - accuracy: 0.8203
Epoch 62/300
6/6 [==============================] - 0s 564us/step - loss: 0.4199 - accuracy: 0.8203
Epoch 63/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4190 - accuracy: 0.8232
Epoch 64/300
6/6 [==============================] - 0s 561us/step - loss: 0.4179 - accuracy: 0.8232
Epoch 65/300
6/6 [==============================] - 0s 568us/step - loss: 0.4173 - accuracy: 0.8232
Epoch 66/300
6/6 [==============================] - 0s 560us/step - loss: 0.4163 - accuracy: 0.8232
Epoch 67/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4154 - accuracy: 0.8261
Epoch 68/300
6/6 [==============================] - 0s 564us/step - loss: 0.4145 - accuracy: 0.8261
Epoch 69/300
6/6 [==============================] - 0s 571us/step - loss: 0.4138 - accuracy: 0.8261
Epoch 70/300
6/6 [==============================] - 0s 562us/step - loss: 0.4130 - accuracy: 0.8319
Epoch 71/300
6/6 [==============================] - 0s 562us/step - loss: 0.4123 - accuracy: 0.8319
Epoch 72/300
6/6 [==============================] - 0s 572us/step - loss: 0.4116 - accuracy: 0.8290
Epoch 73/300
6/6 [==============================] - 0s 559us/step - loss: 0.4108 - accuracy: 0.8319
Epoch 74/300
6/6 [==============================] - 0s 554us/step - loss: 0.4099 - accuracy: 0.8319
Epoch 75/300
6/6 [==============================] - 0s 563us/step - loss: 0.4092 - accuracy: 0.8319
Epoch 76/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4086 - accuracy: 0.8319
Epoch 77/300
6/6 [==============================] - 0s 620us/step - loss: 0.4077 - accuracy: 0.8348
Epoch 78/300
6/6 [==============================] - 0s 621us/step - loss: 0.4070 - accuracy: 0.8377
Epoch 79/300
6/6 [==============================] - 0s 619us/step - loss: 0.4065 - accuracy: 0.8319
Epoch 80/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4056 - accuracy: 0.8348
Epoch 81/300
6/6 [==============================] - 0s 626us/step - loss: 0.4050 - accuracy: 0.8348
Epoch 82/300
6/6 [==============================] - 0s 581us/step - loss: 0.4043 - accuracy: 0.8319
Epoch 83/300
6/6 [==============================] - 0s 584us/step - loss: 0.4036 - accuracy: 0.8319
Epoch 84/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4028 - accuracy: 0.8319
Epoch 85/300
6/6 [==============================] - 0s 589us/step - loss: 0.4022 - accuracy: 0.8290
Epoch 86/300
6/6 [==============================] - 0s 570us/step - loss: 0.4016 - accuracy: 0.8319
Epoch 87/300
6/6 [==============================] - 0s 605us/step - loss: 0.4008 - accuracy: 0.8319
Epoch 88/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4003 - accuracy: 0.8319
Epoch 89/300
6/6 [==============================] - 0s 604us/step - loss: 0.3996 - accuracy: 0.8319
Epoch 90/300
6/6 [==============================] - 0s 588us/step - loss: 0.3990 - accuracy: 0.8319
Epoch 91/300
6/6 [==============================] - 0s 573us/step - loss: 0.3983 - accuracy: 0.8319
Epoch 92/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3977 - accuracy: 0.8290
Epoch 93/300
6/6 [==============================] - 0s 613us/step - loss: 0.3971 - accuracy: 0.8290
Epoch 94/300
6/6 [==============================] - 0s 602us/step - loss: 0.3965 - accuracy: 0.8290
Epoch 95/300
6/6 [==============================] - 0s 601us/step - loss: 0.3960 - accuracy: 0.8261
Epoch 96/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3956 - accuracy: 0.8232
Epoch 97/300
6/6 [==============================] - 0s 576us/step - loss: 0.3951 - accuracy: 0.8232
Epoch 98/300
6/6 [==============================] - 0s 575us/step - loss: 0.3947 - accuracy: 0.8261
Epoch 99/300
6/6 [==============================] - 0s 574us/step - loss: 0.3942 - accuracy: 0.8232
Epoch 100/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3937 - accuracy: 0.8232
Epoch 101/300
6/6 [==============================] - 0s 554us/step - loss: 0.3930 - accuracy: 0.8261
Epoch 102/300
6/6 [==============================] - 0s 581us/step - loss: 0.3927 - accuracy: 0.8290
Epoch 103/300
6/6 [==============================] - 0s 574us/step - loss: 0.3921 - accuracy: 0.8290
Epoch 104/300
6/6 [==============================] - 0s 574us/step - loss: 0.3916 - accuracy: 0.8290
Epoch 105/300
6/6 [==============================] - 0s 572us/step - loss: 0.3911 - accuracy: 0.8290
Epoch 106/300
6/6 [==============================] - 0s 539us/step - loss: 0.3907 - accuracy: 0.8261
Epoch 107/300
6/6 [==============================] - 0s 555us/step - loss: 0.3901 - accuracy: 0.8261
Epoch 108/300
6/6 [==============================] - 0s 553us/step - loss: 0.3896 - accuracy: 0.8290
Epoch 109/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3891 - accuracy: 0.8348
Epoch 110/300
6/6 [==============================] - 0s 560us/step - loss: 0.3888 - accuracy: 0.8319
Epoch 111/300
6/6 [==============================] - 0s 555us/step - loss: 0.3884 - accuracy: 0.8348
Epoch 112/300
6/6 [==============================] - 0s 542us/step - loss: 0.3878 - accuracy: 0.8377
Epoch 113/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3874 - accuracy: 0.8377
Epoch 114/300
6/6 [==============================] - 0s 579us/step - loss: 0.3868 - accuracy: 0.8377
Epoch 115/300
6/6 [==============================] - 0s 577us/step - loss: 0.3864 - accuracy: 0.8377
Epoch 116/300
6/6 [==============================] - 0s 578us/step - loss: 0.3860 - accuracy: 0.8348
Epoch 117/300
6/6 [==============================] - 0s 547us/step - loss: 0.3859 - accuracy: 0.8348
Epoch 118/300
6/6 [==============================] - 0s 591us/step - loss: 0.3852 - accuracy: 0.8319
Epoch 119/300
6/6 [==============================] - 0s 565us/step - loss: 0.3847 - accuracy: 0.8348
Epoch 120/300
6/6 [==============================] - 0s 573us/step - loss: 0.3843 - accuracy: 0.8319
Epoch 121/300
6/6 [==============================] - 0s 574us/step - loss: 0.3839 - accuracy: 0.8319
Epoch 122/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3835 - accuracy: 0.8319
Epoch 123/300
6/6 [==============================] - 0s 587us/step - loss: 0.3829 - accuracy: 0.8319
Epoch 124/300
6/6 [==============================] - 0s 582us/step - loss: 0.3825 - accuracy: 0.8319
Epoch 125/300
6/6 [==============================] - 0s 572us/step - loss: 0.3821 - accuracy: 0.8319
Epoch 126/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3817 - accuracy: 0.8319
Epoch 127/300
6/6 [==============================] - 0s 576us/step - loss: 0.3813 - accuracy: 0.8319
Epoch 128/300
6/6 [==============================] - 0s 551us/step - loss: 0.3808 - accuracy: 0.8319
Epoch 129/300
6/6 [==============================] - 0s 549us/step - loss: 0.3804 - accuracy: 0.8319
Epoch 130/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3801 - accuracy: 0.8319
Epoch 131/300
6/6 [==============================] - 0s 566us/step - loss: 0.3796 - accuracy: 0.8290
Epoch 132/300
6/6 [==============================] - 0s 554us/step - loss: 0.3793 - accuracy: 0.8290
Epoch 133/300
6/6 [==============================] - 0s 570us/step - loss: 0.3789 - accuracy: 0.8319
Epoch 134/300
6/6 [==============================] - 0s 558us/step - loss: 0.3785 - accuracy: 0.8319
Epoch 135/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3781 - accuracy: 0.8319
Epoch 136/300
6/6 [==============================] - 0s 584us/step - loss: 0.3776 - accuracy: 0.8319
Epoch 137/300
6/6 [==============================] - 0s 580us/step - loss: 0.3776 - accuracy: 0.8319
Epoch 138/300
6/6 [==============================] - 0s 573us/step - loss: 0.3770 - accuracy: 0.8348
Epoch 139/300
6/6 [==============================] - 0s 582us/step - loss: 0.3766 - accuracy: 0.8319
Epoch 140/300
6/6 [==============================] - 0s 582us/step - loss: 0.3763 - accuracy: 0.8348
Epoch 141/300
6/6 [==============================] - 0s 593us/step - loss: 0.3758 - accuracy: 0.8348
Epoch 142/300
6/6 [==============================] - 0s 568us/step - loss: 0.3756 - accuracy: 0.8319
Epoch 143/300
6/6 [==============================] - 0s 561us/step - loss: 0.3754 - accuracy: 0.8348
Epoch 144/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3750 - accuracy: 0.8348
Epoch 145/300
6/6 [==============================] - 0s 579us/step - loss: 0.3746 - accuracy: 0.8319
Epoch 146/300
6/6 [==============================] - 0s 554us/step - loss: 0.3743 - accuracy: 0.8319
Epoch 147/300
6/6 [==============================] - 0s 572us/step - loss: 0.3741 - accuracy: 0.8348
Epoch 148/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3738 - accuracy: 0.8319
Epoch 149/300
6/6 [==============================] - 0s 569us/step - loss: 0.3735 - accuracy: 0.8348
Epoch 150/300
6/6 [==============================] - 0s 565us/step - loss: 0.3732 - accuracy: 0.8348
Epoch 151/300
6/6 [==============================] - 0s 558us/step - loss: 0.3729 - accuracy: 0.8348
Epoch 152/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3725 - accuracy: 0.8319
Epoch 153/300
6/6 [==============================] - 0s 562us/step - loss: 0.3725 - accuracy: 0.8290
Epoch 154/300
6/6 [==============================] - 0s 578us/step - loss: 0.3719 - accuracy: 0.8319
Epoch 155/300
6/6 [==============================] - 0s 568us/step - loss: 0.3717 - accuracy: 0.8348
Epoch 156/300
6/6 [==============================] - 0s 568us/step - loss: 0.3714 - accuracy: 0.8348
Epoch 157/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3711 - accuracy: 0.8348
Epoch 158/300
6/6 [==============================] - 0s 573us/step - loss: 0.3709 - accuracy: 0.8377
Epoch 159/300
6/6 [==============================] - 0s 547us/step - loss: 0.3706 - accuracy: 0.8377
Epoch 160/300
6/6 [==============================] - 0s 559us/step - loss: 0.3703 - accuracy: 0.8377
Epoch 161/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3700 - accuracy: 0.8377
Epoch 162/300
6/6 [==============================] - 0s 591us/step - loss: 0.3696 - accuracy: 0.8348
Epoch 163/300
6/6 [==============================] - 0s 581us/step - loss: 0.3695 - accuracy: 0.8377
Epoch 164/300
6/6 [==============================] - 0s 567us/step - loss: 0.3690 - accuracy: 0.8377
Epoch 165/300
6/6 [==============================] - 0s 572us/step - loss: 0.3689 - accuracy: 0.8377
Epoch 166/300
6/6 [==============================] - 0s 576us/step - loss: 0.3685 - accuracy: 0.8377
Epoch 167/300
6/6 [==============================] - 0s 556us/step - loss: 0.3683 - accuracy: 0.8377
Epoch 168/300
6/6 [==============================] - 0s 564us/step - loss: 0.3681 - accuracy: 0.8377
Epoch 169/300
6/6 [==============================] - 0s 567us/step - loss: 0.3679 - accuracy: 0.8406
Epoch 170/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3678 - accuracy: 0.8377
Epoch 171/300
6/6 [==============================] - 0s 578us/step - loss: 0.3673 - accuracy: 0.8377
Epoch 172/300
6/6 [==============================] - 0s 565us/step - loss: 0.3669 - accuracy: 0.8377
Epoch 173/300
6/6 [==============================] - 0s 573us/step - loss: 0.3666 - accuracy: 0.8406
Epoch 174/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3664 - accuracy: 0.8406
Epoch 175/300
6/6 [==============================] - 0s 566us/step - loss: 0.3661 - accuracy: 0.8435
Epoch 176/300
6/6 [==============================] - 0s 578us/step - loss: 0.3658 - accuracy: 0.8435
Epoch 177/300
6/6 [==============================] - 0s 557us/step - loss: 0.3657 - accuracy: 0.8435
Epoch 178/300
6/6 [==============================] - 0s 541us/step - loss: 0.3655 - accuracy: 0.8435
Epoch 179/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3653 - accuracy: 0.8435
Epoch 180/300
6/6 [==============================] - 0s 571us/step - loss: 0.3650 - accuracy: 0.8406
Epoch 181/300
6/6 [==============================] - 0s 572us/step - loss: 0.3647 - accuracy: 0.8435
Epoch 182/300
6/6 [==============================] - 0s 551us/step - loss: 0.3643 - accuracy: 0.8435
Epoch 183/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3641 - accuracy: 0.8435
Epoch 184/300
6/6 [==============================] - 0s 580us/step - loss: 0.3638 - accuracy: 0.8464
Epoch 185/300
6/6 [==============================] - 0s 565us/step - loss: 0.3637 - accuracy: 0.8464
Epoch 186/300
6/6 [==============================] - 0s 558us/step - loss: 0.3631 - accuracy: 0.8464
Epoch 187/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3630 - accuracy: 0.8435
Epoch 188/300
6/6 [==============================] - 0s 559us/step - loss: 0.3627 - accuracy: 0.8377
Epoch 189/300
6/6 [==============================] - 0s 558us/step - loss: 0.3625 - accuracy: 0.8377
Epoch 190/300
6/6 [==============================] - 0s 552us/step - loss: 0.3622 - accuracy: 0.8377
Epoch 191/300
6/6 [==============================] - 0s 563us/step - loss: 0.3620 - accuracy: 0.8377
Epoch 192/300
6/6 [==============================] - 0s 597us/step - loss: 0.3617 - accuracy: 0.8406
Epoch 193/300
6/6 [==============================] - 0s 611us/step - loss: 0.3614 - accuracy: 0.8435
Epoch 194/300
6/6 [==============================] - 0s 590us/step - loss: 0.3612 - accuracy: 0.8435
Epoch 195/300
6/6 [==============================] - 0s 587us/step - loss: 0.3609 - accuracy: 0.8435
Epoch 196/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3606 - accuracy: 0.8435
Epoch 197/300
6/6 [==============================] - 0s 591us/step - loss: 0.3604 - accuracy: 0.8435
Epoch 198/300
6/6 [==============================] - 0s 595us/step - loss: 0.3601 - accuracy: 0.8406
Epoch 199/300
6/6 [==============================] - 0s 595us/step - loss: 0.3601 - accuracy: 0.8406
Epoch 200/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3598 - accuracy: 0.8406
Epoch 201/300
6/6 [==============================] - 0s 576us/step - loss: 0.3596 - accuracy: 0.8406
Epoch 202/300
6/6 [==============================] - 0s 589us/step - loss: 0.3593 - accuracy: 0.8406
Epoch 203/300
6/6 [==============================] - 0s 587us/step - loss: 0.3592 - accuracy: 0.8377
Epoch 204/300
6/6 [==============================] - 0s 574us/step - loss: 0.3587 - accuracy: 0.8377
Epoch 205/300
6/6 [==============================] - 0s 599us/step - loss: 0.3586 - accuracy: 0.8377
Epoch 206/300
6/6 [==============================] - 0s 571us/step - loss: 0.3582 - accuracy: 0.8377
Epoch 207/300
6/6 [==============================] - 0s 590us/step - loss: 0.3580 - accuracy: 0.8406
Epoch 208/300
6/6 [==============================] - 0s 590us/step - loss: 0.3577 - accuracy: 0.8406
Epoch 209/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3573 - accuracy: 0.8406
Epoch 210/300
6/6 [==============================] - 0s 590us/step - loss: 0.3573 - accuracy: 0.8406
Epoch 211/300
6/6 [==============================] - 0s 576us/step - loss: 0.3570 - accuracy: 0.8435
Epoch 212/300
6/6 [==============================] - 0s 564us/step - loss: 0.3568 - accuracy: 0.8435
Epoch 213/300
6/6 [==============================] - 0s 576us/step - loss: 0.3565 - accuracy: 0.8464
Epoch 214/300
6/6 [==============================] - 0s 576us/step - loss: 0.3562 - accuracy: 0.8435
Epoch 215/300
6/6 [==============================] - 0s 561us/step - loss: 0.3563 - accuracy: 0.8464
Epoch 216/300
6/6 [==============================] - 0s 563us/step - loss: 0.3561 - accuracy: 0.8464
Epoch 217/300
6/6 [==============================] - 0s 568us/step - loss: 0.3558 - accuracy: 0.8464
Epoch 218/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3554 - accuracy: 0.8435
Epoch 219/300
6/6 [==============================] - 0s 583us/step - loss: 0.3552 - accuracy: 0.8435
Epoch 220/300
6/6 [==============================] - 0s 577us/step - loss: 0.3551 - accuracy: 0.8464
Epoch 221/300
6/6 [==============================] - 0s 569us/step - loss: 0.3550 - accuracy: 0.8464
Epoch 222/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3548 - accuracy: 0.8464
Epoch 223/300
6/6 [==============================] - 0s 585us/step - loss: 0.3551 - accuracy: 0.8435
Epoch 224/300
6/6 [==============================] - 0s 606us/step - loss: 0.3543 - accuracy: 0.8435
Epoch 225/300
6/6 [==============================] - 0s 566us/step - loss: 0.3542 - accuracy: 0.8464
Epoch 226/300
6/6 [==============================] - 0s 582us/step - loss: 0.3539 - accuracy: 0.8435
Epoch 227/300
6/6 [==============================] - 0s 592us/step - loss: 0.3536 - accuracy: 0.8464
Epoch 228/300
6/6 [==============================] - 0s 579us/step - loss: 0.3534 - accuracy: 0.8435
Epoch 229/300
6/6 [==============================] - 0s 594us/step - loss: 0.3533 - accuracy: 0.8464
Epoch 230/300
6/6 [==============================] - 0s 594us/step - loss: 0.3531 - accuracy: 0.8464
Epoch 231/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3529 - accuracy: 0.8464
Epoch 232/300
6/6 [==============================] - 0s 580us/step - loss: 0.3531 - accuracy: 0.8464
Epoch 233/300
6/6 [==============================] - 0s 583us/step - loss: 0.3528 - accuracy: 0.8464
Epoch 234/300
6/6 [==============================] - 0s 555us/step - loss: 0.3525 - accuracy: 0.8464
Epoch 235/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3522 - accuracy: 0.8435
Epoch 236/300
6/6 [==============================] - 0s 578us/step - loss: 0.3522 - accuracy: 0.8435
Epoch 237/300
6/6 [==============================] - 0s 636us/step - loss: 0.3520 - accuracy: 0.8435
Epoch 238/300
6/6 [==============================] - 0s 629us/step - loss: 0.3519 - accuracy: 0.8435
Epoch 239/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3520 - accuracy: 0.8435
Epoch 240/300
6/6 [==============================] - 0s 657us/step - loss: 0.3516 - accuracy: 0.8435
Epoch 241/300
6/6 [==============================] - 0s 642us/step - loss: 0.3516 - accuracy: 0.8435
Epoch 242/300
6/6 [==============================] - 0s 607us/step - loss: 0.3512 - accuracy: 0.8406
Epoch 243/300
6/6 [==============================] - 0s 625us/step - loss: 0.3511 - accuracy: 0.8406
Epoch 244/300
6/6 [==============================] - 0s 585us/step - loss: 0.3511 - accuracy: 0.8406
Epoch 245/300
6/6 [==============================] - 0s 602us/step - loss: 0.3509 - accuracy: 0.8406
Epoch 246/300
6/6 [==============================] - 0s 607us/step - loss: 0.3506 - accuracy: 0.8406
Epoch 247/300
6/6 [==============================] - 0s 613us/step - loss: 0.3506 - accuracy: 0.8406
Epoch 248/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3505 - accuracy: 0.8435
Epoch 249/300
6/6 [==============================] - 0s 653us/step - loss: 0.3502 - accuracy: 0.8435
Epoch 250/300
6/6 [==============================] - 0s 634us/step - loss: 0.3500 - accuracy: 0.8406
Epoch 251/300
6/6 [==============================] - 0s 632us/step - loss: 0.3499 - accuracy: 0.8406
Epoch 252/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3498 - accuracy: 0.8406
Epoch 253/300
6/6 [==============================] - 0s 564us/step - loss: 0.3495 - accuracy: 0.8406
Epoch 254/300
6/6 [==============================] - 0s 551us/step - loss: 0.3493 - accuracy: 0.8406
Epoch 255/300
6/6 [==============================] - 0s 551us/step - loss: 0.3491 - accuracy: 0.8406
Epoch 256/300
6/6 [==============================] - 0s 538us/step - loss: 0.3490 - accuracy: 0.8435
Epoch 257/300
6/6 [==============================] - 0s 535us/step - loss: 0.3490 - accuracy: 0.8435
Epoch 258/300
6/6 [==============================] - 0s 558us/step - loss: 0.3489 - accuracy: 0.8435
Epoch 259/300
6/6 [==============================] - 0s 528us/step - loss: 0.3488 - accuracy: 0.8406
Epoch 260/300
6/6 [==============================] - 0s 547us/step - loss: 0.3485 - accuracy: 0.8406
Epoch 261/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3486 - accuracy: 0.8435
Epoch 262/300
6/6 [==============================] - 0s 542us/step - loss: 0.3482 - accuracy: 0.8406
Epoch 263/300
6/6 [==============================] - 0s 548us/step - loss: 0.3480 - accuracy: 0.8406
Epoch 264/300
6/6 [==============================] - 0s 550us/step - loss: 0.3478 - accuracy: 0.8435
Epoch 265/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3478 - accuracy: 0.8464
Epoch 266/300
6/6 [==============================] - 0s 541us/step - loss: 0.3476 - accuracy: 0.8435
Epoch 267/300
6/6 [==============================] - 0s 541us/step - loss: 0.3477 - accuracy: 0.8435
Epoch 268/300
6/6 [==============================] - 0s 532us/step - loss: 0.3472 - accuracy: 0.8435
Epoch 269/300
6/6 [==============================] - 0s 602us/step - loss: 0.3471 - accuracy: 0.8435
Epoch 270/300
6/6 [==============================] - 0s 611us/step - loss: 0.3473 - accuracy: 0.8435
Epoch 271/300
6/6 [==============================] - 0s 630us/step - loss: 0.3471 - accuracy: 0.8435
Epoch 272/300
6/6 [==============================] - 0s 549us/step - loss: 0.3471 - accuracy: 0.8435
Epoch 273/300
6/6 [==============================] - 0s 598us/step - loss: 0.3467 - accuracy: 0.8435
Epoch 274/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3466 - accuracy: 0.8464
Epoch 275/300
6/6 [==============================] - 0s 632us/step - loss: 0.3463 - accuracy: 0.8435
Epoch 276/300
6/6 [==============================] - 0s 593us/step - loss: 0.3461 - accuracy: 0.8435
Epoch 277/300
6/6 [==============================] - 0s 613us/step - loss: 0.3460 - accuracy: 0.8435
Epoch 278/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3458 - accuracy: 0.8435
Epoch 279/300
6/6 [==============================] - 0s 662us/step - loss: 0.3457 - accuracy: 0.8435
Epoch 280/300
6/6 [==============================] - 0s 585us/step - loss: 0.3457 - accuracy: 0.8406
Epoch 281/300
6/6 [==============================] - 0s 587us/step - loss: 0.3455 - accuracy: 0.8406
Epoch 282/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3455 - accuracy: 0.8377
Epoch 283/300
6/6 [==============================] - 0s 550us/step - loss: 0.3453 - accuracy: 0.8377
Epoch 284/300
6/6 [==============================] - 0s 552us/step - loss: 0.3449 - accuracy: 0.8377
Epoch 285/300
6/6 [==============================] - 0s 612us/step - loss: 0.3450 - accuracy: 0.8406
Epoch 286/300
6/6 [==============================] - 0s 599us/step - loss: 0.3447 - accuracy: 0.8406
Epoch 287/300
6/6 [==============================] - 0s 632us/step - loss: 0.3446 - accuracy: 0.8377
Epoch 288/300
6/6 [==============================] - 0s 631us/step - loss: 0.3445 - accuracy: 0.8377
Epoch 289/300
6/6 [==============================] - 0s 631us/step - loss: 0.3443 - accuracy: 0.8406
Epoch 290/300
6/6 [==============================] - 0s 571us/step - loss: 0.3441 - accuracy: 0.8406
Epoch 291/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3440 - accuracy: 0.8406
Epoch 292/300
6/6 [==============================] - 0s 625us/step - loss: 0.3438 - accuracy: 0.8406
Epoch 293/300
6/6 [==============================] - 0s 661us/step - loss: 0.3435 - accuracy: 0.8377
Epoch 294/300
6/6 [==============================] - 0s 638us/step - loss: 0.3434 - accuracy: 0.8377
Epoch 295/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3436 - accuracy: 0.8377
Epoch 296/300
6/6 [==============================] - 0s 682us/step - loss: 0.3430 - accuracy: 0.8377
Epoch 297/300
6/6 [==============================] - 0s 643us/step - loss: 0.3430 - accuracy: 0.8435
Epoch 298/300
6/6 [==============================] - 0s 615us/step - loss: 0.3429 - accuracy: 0.8435
Epoch 299/300
6/6 [==============================] - 0s 635us/step - loss: 0.3429 - accuracy: 0.8435
Epoch 300/300
6/6 [==============================] - 0s 654us/step - loss: 0.3426 - accuracy: 0.8435
Epoch 1/300
6/6 [==============================] - 0s 11ms/step - loss: 0.6502 - accuracy: 0.6696
Epoch 2/300
6/6 [==============================] - 0s 649us/step - loss: 0.6369 - accuracy: 0.6783
Epoch 3/300
6/6 [==============================] - 0s 641us/step - loss: 0.6243 - accuracy: 0.6957
Epoch 4/300
6/6 [==============================] - 0s 14ms/step - loss: 0.6124 - accuracy: 0.6986
Epoch 5/300
6/6 [==============================] - 0s 622us/step - loss: 0.6013 - accuracy: 0.7014
Epoch 6/300
6/6 [==============================] - 0s 679us/step - loss: 0.5906 - accuracy: 0.7072
Epoch 7/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5806 - accuracy: 0.7159
Epoch 8/300
6/6 [==============================] - 0s 634us/step - loss: 0.5705 - accuracy: 0.7246
Epoch 9/300
6/6 [==============================] - 0s 600us/step - loss: 0.5614 - accuracy: 0.7275
Epoch 10/300
6/6 [==============================] - 0s 629us/step - loss: 0.5529 - accuracy: 0.7246
Epoch 11/300
6/6 [==============================] - 0s 591us/step - loss: 0.5443 - accuracy: 0.7246
Epoch 12/300
6/6 [==============================] - 0s 591us/step - loss: 0.5368 - accuracy: 0.7304
Epoch 13/300
6/6 [==============================] - 0s 663us/step - loss: 0.5298 - accuracy: 0.7333
Epoch 14/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5227 - accuracy: 0.7362
Epoch 15/300
6/6 [==============================] - 0s 687us/step - loss: 0.5163 - accuracy: 0.7420
Epoch 16/300
6/6 [==============================] - 0s 702us/step - loss: 0.5103 - accuracy: 0.7594
Epoch 17/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5044 - accuracy: 0.7594
Epoch 18/300
6/6 [==============================] - 0s 621us/step - loss: 0.4991 - accuracy: 0.7681
Epoch 19/300
6/6 [==============================] - 0s 652us/step - loss: 0.4938 - accuracy: 0.7652
Epoch 20/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4890 - accuracy: 0.7681
Epoch 21/300
6/6 [==============================] - 0s 646us/step - loss: 0.4851 - accuracy: 0.7681
Epoch 22/300
6/6 [==============================] - 0s 603us/step - loss: 0.4810 - accuracy: 0.7797
Epoch 23/300
6/6 [==============================] - 0s 667us/step - loss: 0.4771 - accuracy: 0.7768
Epoch 24/300
6/6 [==============================] - 0s 661us/step - loss: 0.4735 - accuracy: 0.7768
Epoch 25/300
6/6 [==============================] - 0s 631us/step - loss: 0.4699 - accuracy: 0.7826
Epoch 26/300
6/6 [==============================] - 0s 622us/step - loss: 0.4668 - accuracy: 0.7855
Epoch 27/300
6/6 [==============================] - 0s 668us/step - loss: 0.4639 - accuracy: 0.7913
Epoch 28/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4610 - accuracy: 0.7913
Epoch 29/300
6/6 [==============================] - 0s 617us/step - loss: 0.4585 - accuracy: 0.7884
Epoch 30/300
6/6 [==============================] - 0s 589us/step - loss: 0.4561 - accuracy: 0.7855
Epoch 31/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4536 - accuracy: 0.7913
Epoch 32/300
6/6 [==============================] - 0s 590us/step - loss: 0.4515 - accuracy: 0.7884
Epoch 33/300
6/6 [==============================] - 0s 616us/step - loss: 0.4494 - accuracy: 0.7884
Epoch 34/300
6/6 [==============================] - 0s 637us/step - loss: 0.4476 - accuracy: 0.7884
Epoch 35/300
6/6 [==============================] - 0s 593us/step - loss: 0.4457 - accuracy: 0.7913
Epoch 36/300
6/6 [==============================] - 0s 635us/step - loss: 0.4442 - accuracy: 0.7913
Epoch 37/300
6/6 [==============================] - 0s 625us/step - loss: 0.4427 - accuracy: 0.7913
Epoch 38/300
6/6 [==============================] - 0s 632us/step - loss: 0.4409 - accuracy: 0.7942
Epoch 39/300
6/6 [==============================] - 0s 613us/step - loss: 0.4396 - accuracy: 0.7942
Epoch 40/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4382 - accuracy: 0.7942
Epoch 41/300
6/6 [==============================] - 0s 653us/step - loss: 0.4368 - accuracy: 0.7942
Epoch 42/300
6/6 [==============================] - 0s 593us/step - loss: 0.4356 - accuracy: 0.7942
Epoch 43/300
6/6 [==============================] - 0s 524us/step - loss: 0.4345 - accuracy: 0.7942
Epoch 44/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4331 - accuracy: 0.7971
Epoch 45/300
6/6 [==============================] - 0s 540us/step - loss: 0.4321 - accuracy: 0.7971
Epoch 46/300
6/6 [==============================] - 0s 519us/step - loss: 0.4309 - accuracy: 0.7971
Epoch 47/300
6/6 [==============================] - 0s 531us/step - loss: 0.4299 - accuracy: 0.7971
Epoch 48/300
6/6 [==============================] - 0s 515us/step - loss: 0.4287 - accuracy: 0.7913
Epoch 49/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4277 - accuracy: 0.7913
Epoch 50/300
6/6 [==============================] - 0s 528us/step - loss: 0.4267 - accuracy: 0.8000
Epoch 51/300
6/6 [==============================] - 0s 528us/step - loss: 0.4256 - accuracy: 0.8029
Epoch 52/300
6/6 [==============================] - 0s 525us/step - loss: 0.4246 - accuracy: 0.8029
Epoch 53/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4241 - accuracy: 0.8029
Epoch 54/300
6/6 [==============================] - 0s 546us/step - loss: 0.4231 - accuracy: 0.8029
Epoch 55/300
6/6 [==============================] - 0s 541us/step - loss: 0.4220 - accuracy: 0.8029
Epoch 56/300
6/6 [==============================] - 0s 522us/step - loss: 0.4213 - accuracy: 0.8029
Epoch 57/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4205 - accuracy: 0.8029
Epoch 58/300
6/6 [==============================] - 0s 576us/step - loss: 0.4200 - accuracy: 0.8029
Epoch 59/300
6/6 [==============================] - 0s 528us/step - loss: 0.4194 - accuracy: 0.8029
Epoch 60/300
6/6 [==============================] - 0s 525us/step - loss: 0.4185 - accuracy: 0.8029
Epoch 61/300
6/6 [==============================] - 0s 520us/step - loss: 0.4176 - accuracy: 0.8029
Epoch 62/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4167 - accuracy: 0.8000
Epoch 63/300
6/6 [==============================] - 0s 522us/step - loss: 0.4163 - accuracy: 0.8058
Epoch 64/300
6/6 [==============================] - 0s 528us/step - loss: 0.4153 - accuracy: 0.8058
Epoch 65/300
6/6 [==============================] - 0s 514us/step - loss: 0.4146 - accuracy: 0.8058
Epoch 66/300
6/6 [==============================] - 0s 533us/step - loss: 0.4138 - accuracy: 0.8058
Epoch 67/300
6/6 [==============================] - 0s 547us/step - loss: 0.4131 - accuracy: 0.8058
Epoch 68/300
6/6 [==============================] - 0s 526us/step - loss: 0.4124 - accuracy: 0.8087
Epoch 69/300
6/6 [==============================] - 0s 520us/step - loss: 0.4116 - accuracy: 0.8116
Epoch 70/300
6/6 [==============================] - 0s 529us/step - loss: 0.4111 - accuracy: 0.8087
Epoch 71/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4102 - accuracy: 0.8087
Epoch 72/300
6/6 [==============================] - 0s 577us/step - loss: 0.4095 - accuracy: 0.8058
Epoch 73/300
6/6 [==============================] - 0s 539us/step - loss: 0.4089 - accuracy: 0.8058
Epoch 74/300
6/6 [==============================] - 0s 533us/step - loss: 0.4081 - accuracy: 0.8058
Epoch 75/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4074 - accuracy: 0.8058
Epoch 76/300
6/6 [==============================] - 0s 547us/step - loss: 0.4070 - accuracy: 0.8029
Epoch 77/300
6/6 [==============================] - 0s 540us/step - loss: 0.4062 - accuracy: 0.8058
Epoch 78/300
6/6 [==============================] - 0s 540us/step - loss: 0.4058 - accuracy: 0.8145
Epoch 79/300
6/6 [==============================] - 0s 576us/step - loss: 0.4050 - accuracy: 0.8145
Epoch 80/300
6/6 [==============================] - 0s 621us/step - loss: 0.4046 - accuracy: 0.8145
Epoch 81/300
6/6 [==============================] - 0s 618us/step - loss: 0.4039 - accuracy: 0.8145
Epoch 82/300
6/6 [==============================] - 0s 573us/step - loss: 0.4034 - accuracy: 0.8145
Epoch 83/300
6/6 [==============================] - 0s 538us/step - loss: 0.4029 - accuracy: 0.8145
Epoch 84/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4022 - accuracy: 0.8145
Epoch 85/300
6/6 [==============================] - 0s 652us/step - loss: 0.4016 - accuracy: 0.8145
Epoch 86/300
6/6 [==============================] - 0s 637us/step - loss: 0.4011 - accuracy: 0.8174
Epoch 87/300
6/6 [==============================] - 0s 608us/step - loss: 0.4005 - accuracy: 0.8145
Epoch 88/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4000 - accuracy: 0.8145
Epoch 89/300
6/6 [==============================] - 0s 651us/step - loss: 0.3996 - accuracy: 0.8116
Epoch 90/300
6/6 [==============================] - 0s 632us/step - loss: 0.3989 - accuracy: 0.8087
Epoch 91/300
6/6 [==============================] - 0s 605us/step - loss: 0.3984 - accuracy: 0.8087
Epoch 92/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3980 - accuracy: 0.8145
Epoch 93/300
6/6 [==============================] - 0s 539us/step - loss: 0.3976 - accuracy: 0.8116
Epoch 94/300
6/6 [==============================] - 0s 535us/step - loss: 0.3972 - accuracy: 0.8087
Epoch 95/300
6/6 [==============================] - 0s 527us/step - loss: 0.3967 - accuracy: 0.8058
Epoch 96/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3961 - accuracy: 0.8058
Epoch 97/300
6/6 [==============================] - 0s 588us/step - loss: 0.3958 - accuracy: 0.8029
Epoch 98/300
6/6 [==============================] - 0s 596us/step - loss: 0.3954 - accuracy: 0.8058
Epoch 99/300
6/6 [==============================] - 0s 595us/step - loss: 0.3951 - accuracy: 0.8058
Epoch 100/300
6/6 [==============================] - 0s 700us/step - loss: 0.3949 - accuracy: 0.8058
Epoch 101/300
6/6 [==============================] - 0s 553us/step - loss: 0.3941 - accuracy: 0.8058
Epoch 102/300
6/6 [==============================] - 0s 542us/step - loss: 0.3937 - accuracy: 0.8058
Epoch 103/300
6/6 [==============================] - 0s 666us/step - loss: 0.3932 - accuracy: 0.8058
Epoch 104/300
6/6 [==============================] - 0s 680us/step - loss: 0.3928 - accuracy: 0.8058
Epoch 105/300
6/6 [==============================] - 0s 577us/step - loss: 0.3923 - accuracy: 0.8058
Epoch 106/300
6/6 [==============================] - 0s 573us/step - loss: 0.3920 - accuracy: 0.8058
Epoch 107/300
6/6 [==============================] - 0s 586us/step - loss: 0.3916 - accuracy: 0.8087
Epoch 108/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3912 - accuracy: 0.8087
Epoch 109/300
6/6 [==============================] - 0s 638us/step - loss: 0.3909 - accuracy: 0.8087
Epoch 110/300
6/6 [==============================] - 0s 627us/step - loss: 0.3904 - accuracy: 0.8058
Epoch 111/300
6/6 [==============================] - 0s 650us/step - loss: 0.3901 - accuracy: 0.8058
Epoch 112/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3898 - accuracy: 0.8058
Epoch 113/300
6/6 [==============================] - 0s 644us/step - loss: 0.3894 - accuracy: 0.8058
Epoch 114/300
6/6 [==============================] - 0s 646us/step - loss: 0.3892 - accuracy: 0.8058
Epoch 115/300
6/6 [==============================] - 0s 707us/step - loss: 0.3887 - accuracy: 0.8058
Epoch 116/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3883 - accuracy: 0.8087
Epoch 117/300
6/6 [==============================] - 0s 668us/step - loss: 0.3880 - accuracy: 0.8087
Epoch 118/300
6/6 [==============================] - 0s 576us/step - loss: 0.3876 - accuracy: 0.8087
Epoch 119/300
6/6 [==============================] - 0s 593us/step - loss: 0.3873 - accuracy: 0.8087
Epoch 120/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3869 - accuracy: 0.8087
Epoch 121/300
6/6 [==============================] - 0s 584us/step - loss: 0.3867 - accuracy: 0.8087
Epoch 122/300
6/6 [==============================] - 0s 603us/step - loss: 0.3866 - accuracy: 0.8087
Epoch 123/300
6/6 [==============================] - 0s 627us/step - loss: 0.3861 - accuracy: 0.8087
Epoch 124/300
6/6 [==============================] - 0s 608us/step - loss: 0.3859 - accuracy: 0.8087
Epoch 125/300
6/6 [==============================] - 0s 629us/step - loss: 0.3855 - accuracy: 0.8087
Epoch 126/300
6/6 [==============================] - 0s 591us/step - loss: 0.3852 - accuracy: 0.8087
Epoch 127/300
6/6 [==============================] - 0s 592us/step - loss: 0.3848 - accuracy: 0.8087
Epoch 128/300
6/6 [==============================] - 0s 649us/step - loss: 0.3845 - accuracy: 0.8087
Epoch 129/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3841 - accuracy: 0.8087
Epoch 130/300
6/6 [==============================] - 0s 641us/step - loss: 0.3836 - accuracy: 0.8087
Epoch 131/300
6/6 [==============================] - 0s 587us/step - loss: 0.3831 - accuracy: 0.8058
Epoch 132/300
6/6 [==============================] - 0s 636us/step - loss: 0.3830 - accuracy: 0.8087
Epoch 133/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3827 - accuracy: 0.8058
Epoch 134/300
6/6 [==============================] - 0s 608us/step - loss: 0.3822 - accuracy: 0.8058
Epoch 135/300
6/6 [==============================] - 0s 622us/step - loss: 0.3817 - accuracy: 0.8087
Epoch 136/300
6/6 [==============================] - 0s 654us/step - loss: 0.3815 - accuracy: 0.8087
Epoch 137/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3811 - accuracy: 0.8087
Epoch 138/300
6/6 [==============================] - 0s 624us/step - loss: 0.3808 - accuracy: 0.8087
Epoch 139/300
6/6 [==============================] - 0s 615us/step - loss: 0.3804 - accuracy: 0.8087
Epoch 140/300
6/6 [==============================] - 0s 644us/step - loss: 0.3802 - accuracy: 0.8087
Epoch 141/300
6/6 [==============================] - 0s 614us/step - loss: 0.3797 - accuracy: 0.8087
Epoch 142/300
6/6 [==============================] - 0s 661us/step - loss: 0.3792 - accuracy: 0.8087
Epoch 143/300
6/6 [==============================] - 0s 651us/step - loss: 0.3791 - accuracy: 0.8087
Epoch 144/300
6/6 [==============================] - 0s 644us/step - loss: 0.3788 - accuracy: 0.8087
Epoch 145/300
6/6 [==============================] - 0s 638us/step - loss: 0.3785 - accuracy: 0.8116
Epoch 146/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3780 - accuracy: 0.8145
Epoch 147/300
6/6 [==============================] - 0s 533us/step - loss: 0.3776 - accuracy: 0.8145
Epoch 148/300
6/6 [==============================] - 0s 525us/step - loss: 0.3774 - accuracy: 0.8145
Epoch 149/300
6/6 [==============================] - 0s 550us/step - loss: 0.3771 - accuracy: 0.8145
Epoch 150/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3768 - accuracy: 0.8145
Epoch 151/300
6/6 [==============================] - 0s 539us/step - loss: 0.3765 - accuracy: 0.8145
Epoch 152/300
6/6 [==============================] - 0s 519us/step - loss: 0.3762 - accuracy: 0.8145
Epoch 153/300
6/6 [==============================] - 0s 536us/step - loss: 0.3759 - accuracy: 0.8145
Epoch 154/300
6/6 [==============================] - 0s 514us/step - loss: 0.3756 - accuracy: 0.8145
Epoch 155/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3755 - accuracy: 0.8145
Epoch 156/300
6/6 [==============================] - 0s 551us/step - loss: 0.3754 - accuracy: 0.8145
Epoch 157/300
6/6 [==============================] - 0s 553us/step - loss: 0.3750 - accuracy: 0.8145
Epoch 158/300
6/6 [==============================] - 0s 544us/step - loss: 0.3748 - accuracy: 0.8145
Epoch 159/300
6/6 [==============================] - 0s 533us/step - loss: 0.3743 - accuracy: 0.8145
Epoch 160/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3741 - accuracy: 0.8145
Epoch 161/300
6/6 [==============================] - 0s 541us/step - loss: 0.3739 - accuracy: 0.8145
Epoch 162/300
6/6 [==============================] - 0s 530us/step - loss: 0.3735 - accuracy: 0.8145
Epoch 163/300
6/6 [==============================] - 0s 524us/step - loss: 0.3733 - accuracy: 0.8174
Epoch 164/300
6/6 [==============================] - 0s 538us/step - loss: 0.3731 - accuracy: 0.8145
Epoch 165/300
6/6 [==============================] - 0s 546us/step - loss: 0.3729 - accuracy: 0.8174
Epoch 166/300
6/6 [==============================] - 0s 526us/step - loss: 0.3725 - accuracy: 0.8145
Epoch 167/300
6/6 [==============================] - 0s 525us/step - loss: 0.3723 - accuracy: 0.8145
Epoch 168/300
6/6 [==============================] - 0s 541us/step - loss: 0.3722 - accuracy: 0.8145
Epoch 169/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3720 - accuracy: 0.8145
Epoch 170/300
6/6 [==============================] - 0s 532us/step - loss: 0.3716 - accuracy: 0.8145
Epoch 171/300
6/6 [==============================] - 0s 530us/step - loss: 0.3714 - accuracy: 0.8174
Epoch 172/300
6/6 [==============================] - 0s 537us/step - loss: 0.3713 - accuracy: 0.8145
Epoch 173/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3710 - accuracy: 0.8145
Epoch 174/300
6/6 [==============================] - 0s 576us/step - loss: 0.3708 - accuracy: 0.8145
Epoch 175/300
6/6 [==============================] - 0s 559us/step - loss: 0.3705 - accuracy: 0.8145
Epoch 176/300
6/6 [==============================] - 0s 552us/step - loss: 0.3703 - accuracy: 0.8145
Epoch 177/300
6/6 [==============================] - 0s 536us/step - loss: 0.3701 - accuracy: 0.8174
Epoch 178/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3698 - accuracy: 0.8145
Epoch 179/300
6/6 [==============================] - 0s 548us/step - loss: 0.3697 - accuracy: 0.8145
Epoch 180/300
6/6 [==============================] - 0s 564us/step - loss: 0.3694 - accuracy: 0.8174
Epoch 181/300
6/6 [==============================] - 0s 525us/step - loss: 0.3694 - accuracy: 0.8174
Epoch 182/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3690 - accuracy: 0.8174
Epoch 183/300
6/6 [==============================] - 0s 834us/step - loss: 0.3689 - accuracy: 0.8174
Epoch 184/300
6/6 [==============================] - 0s 864us/step - loss: 0.3685 - accuracy: 0.8174
Epoch 185/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3684 - accuracy: 0.8174
Epoch 186/300
6/6 [==============================] - 0s 622us/step - loss: 0.3681 - accuracy: 0.8145
Epoch 187/300
6/6 [==============================] - 0s 582us/step - loss: 0.3679 - accuracy: 0.8145
Epoch 188/300
6/6 [==============================] - 0s 570us/step - loss: 0.3676 - accuracy: 0.8145
Epoch 189/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3674 - accuracy: 0.8145
Epoch 190/300
6/6 [==============================] - 0s 622us/step - loss: 0.3672 - accuracy: 0.8145
Epoch 191/300
6/6 [==============================] - 0s 671us/step - loss: 0.3670 - accuracy: 0.8145
Epoch 192/300
6/6 [==============================] - 0s 663us/step - loss: 0.3668 - accuracy: 0.8145
Epoch 193/300
6/6 [==============================] - 0s 663us/step - loss: 0.3669 - accuracy: 0.8145
Epoch 194/300
6/6 [==============================] - 0s 655us/step - loss: 0.3663 - accuracy: 0.8174
Epoch 195/300
6/6 [==============================] - 0s 651us/step - loss: 0.3662 - accuracy: 0.8174
Epoch 196/300
6/6 [==============================] - 0s 606us/step - loss: 0.3659 - accuracy: 0.8203
Epoch 197/300
6/6 [==============================] - 0s 620us/step - loss: 0.3657 - accuracy: 0.8174
Epoch 198/300
6/6 [==============================] - 0s 654us/step - loss: 0.3657 - accuracy: 0.8174
Epoch 199/300
6/6 [==============================] - 0s 626us/step - loss: 0.3653 - accuracy: 0.8203
Epoch 200/300
6/6 [==============================] - 0s 643us/step - loss: 0.3652 - accuracy: 0.8203
Epoch 201/300
6/6 [==============================] - 0s 605us/step - loss: 0.3648 - accuracy: 0.8203
Epoch 202/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3646 - accuracy: 0.8203
Epoch 203/300
6/6 [==============================] - 0s 658us/step - loss: 0.3645 - accuracy: 0.8203
Epoch 204/300
6/6 [==============================] - 0s 628us/step - loss: 0.3643 - accuracy: 0.8174
Epoch 205/300
6/6 [==============================] - 0s 577us/step - loss: 0.3640 - accuracy: 0.8174
Epoch 206/300
6/6 [==============================] - 0s 590us/step - loss: 0.3639 - accuracy: 0.8174
Epoch 207/300
6/6 [==============================] - 0s 639us/step - loss: 0.3636 - accuracy: 0.8174
Epoch 208/300
6/6 [==============================] - 0s 568us/step - loss: 0.3633 - accuracy: 0.8174
Epoch 209/300
6/6 [==============================] - 0s 555us/step - loss: 0.3630 - accuracy: 0.8174
Epoch 210/300
6/6 [==============================] - 0s 560us/step - loss: 0.3628 - accuracy: 0.8174
Epoch 211/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3626 - accuracy: 0.8232
Epoch 212/300
6/6 [==============================] - 0s 623us/step - loss: 0.3625 - accuracy: 0.8232
Epoch 213/300
6/6 [==============================] - 0s 593us/step - loss: 0.3621 - accuracy: 0.8232
Epoch 214/300
6/6 [==============================] - 0s 595us/step - loss: 0.3619 - accuracy: 0.8203
Epoch 215/300
6/6 [==============================] - 0s 545us/step - loss: 0.3617 - accuracy: 0.8203
Epoch 216/300
6/6 [==============================] - 0s 549us/step - loss: 0.3615 - accuracy: 0.8203
Epoch 217/300
6/6 [==============================] - 0s 540us/step - loss: 0.3612 - accuracy: 0.8203
Epoch 218/300
6/6 [==============================] - 0s 535us/step - loss: 0.3610 - accuracy: 0.8203
Epoch 219/300
6/6 [==============================] - 0s 607us/step - loss: 0.3609 - accuracy: 0.8203
Epoch 220/300
6/6 [==============================] - 0s 647us/step - loss: 0.3605 - accuracy: 0.8203
Epoch 221/300
6/6 [==============================] - 0s 621us/step - loss: 0.3603 - accuracy: 0.8203
Epoch 222/300
6/6 [==============================] - 0s 626us/step - loss: 0.3602 - accuracy: 0.8203
Epoch 223/300
6/6 [==============================] - 0s 631us/step - loss: 0.3598 - accuracy: 0.8203
Epoch 224/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3596 - accuracy: 0.8203
Epoch 225/300
6/6 [==============================] - 0s 621us/step - loss: 0.3593 - accuracy: 0.8203
Epoch 226/300
6/6 [==============================] - 0s 599us/step - loss: 0.3590 - accuracy: 0.8203
Epoch 227/300
6/6 [==============================] - 0s 630us/step - loss: 0.3590 - accuracy: 0.8203
Epoch 228/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3587 - accuracy: 0.8203
Epoch 229/300
6/6 [==============================] - 0s 581us/step - loss: 0.3584 - accuracy: 0.8203
Epoch 230/300
6/6 [==============================] - 0s 533us/step - loss: 0.3582 - accuracy: 0.8203
Epoch 231/300
6/6 [==============================] - 0s 539us/step - loss: 0.3578 - accuracy: 0.8203
Epoch 232/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3576 - accuracy: 0.8232
Epoch 233/300
6/6 [==============================] - 0s 602us/step - loss: 0.3572 - accuracy: 0.8232
Epoch 234/300
6/6 [==============================] - 0s 576us/step - loss: 0.3570 - accuracy: 0.8232
Epoch 235/300
6/6 [==============================] - 0s 633us/step - loss: 0.3569 - accuracy: 0.8290
Epoch 236/300
6/6 [==============================] - 0s 610us/step - loss: 0.3564 - accuracy: 0.8261
Epoch 237/300
6/6 [==============================] - 0s 627us/step - loss: 0.3564 - accuracy: 0.8261
Epoch 238/300
6/6 [==============================] - 0s 593us/step - loss: 0.3561 - accuracy: 0.8290
Epoch 239/300
6/6 [==============================] - 0s 540us/step - loss: 0.3557 - accuracy: 0.8319
Epoch 240/300
6/6 [==============================] - 0s 545us/step - loss: 0.3558 - accuracy: 0.8348
Epoch 241/300
6/6 [==============================] - 0s 543us/step - loss: 0.3556 - accuracy: 0.8319
Epoch 242/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3550 - accuracy: 0.8290
Epoch 243/300
6/6 [==============================] - 0s 551us/step - loss: 0.3547 - accuracy: 0.8290
Epoch 244/300
6/6 [==============================] - 0s 534us/step - loss: 0.3546 - accuracy: 0.8290
Epoch 245/300
6/6 [==============================] - 0s 552us/step - loss: 0.3544 - accuracy: 0.8319
Epoch 246/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3541 - accuracy: 0.8319
Epoch 247/300
6/6 [==============================] - 0s 558us/step - loss: 0.3538 - accuracy: 0.8319
Epoch 248/300
6/6 [==============================] - 0s 538us/step - loss: 0.3538 - accuracy: 0.8319
Epoch 249/300
6/6 [==============================] - 0s 547us/step - loss: 0.3534 - accuracy: 0.8290
Epoch 250/300
6/6 [==============================] - 0s 539us/step - loss: 0.3531 - accuracy: 0.8290
Epoch 251/300
6/6 [==============================] - 0s 545us/step - loss: 0.3529 - accuracy: 0.8319
Epoch 252/300
6/6 [==============================] - 0s 525us/step - loss: 0.3526 - accuracy: 0.8290
Epoch 253/300
6/6 [==============================] - 0s 542us/step - loss: 0.3523 - accuracy: 0.8319
Epoch 254/300
6/6 [==============================] - 0s 537us/step - loss: 0.3520 - accuracy: 0.8348
Epoch 255/300
6/6 [==============================] - 0s 535us/step - loss: 0.3519 - accuracy: 0.8377
Epoch 256/300
6/6 [==============================] - 0s 558us/step - loss: 0.3515 - accuracy: 0.8348
Epoch 257/300
6/6 [==============================] - 0s 530us/step - loss: 0.3514 - accuracy: 0.8319
Epoch 258/300
6/6 [==============================] - 0s 528us/step - loss: 0.3511 - accuracy: 0.8319
Epoch 259/300
6/6 [==============================] - 0s 533us/step - loss: 0.3509 - accuracy: 0.8319
Epoch 260/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3506 - accuracy: 0.8348
Epoch 261/300
6/6 [==============================] - 0s 533us/step - loss: 0.3504 - accuracy: 0.8348
Epoch 262/300
6/6 [==============================] - 0s 526us/step - loss: 0.3502 - accuracy: 0.8348
Epoch 263/300
6/6 [==============================] - 0s 522us/step - loss: 0.3500 - accuracy: 0.8348
Epoch 264/300
6/6 [==============================] - 0s 534us/step - loss: 0.3497 - accuracy: 0.8348
Epoch 265/300
6/6 [==============================] - 0s 551us/step - loss: 0.3497 - accuracy: 0.8377
Epoch 266/300
6/6 [==============================] - 0s 530us/step - loss: 0.3493 - accuracy: 0.8377
Epoch 267/300
6/6 [==============================] - 0s 573us/step - loss: 0.3490 - accuracy: 0.8348
Epoch 268/300
6/6 [==============================] - 0s 538us/step - loss: 0.3489 - accuracy: 0.8348
Epoch 269/300
6/6 [==============================] - 0s 565us/step - loss: 0.3488 - accuracy: 0.8319
Epoch 270/300
6/6 [==============================] - 0s 535us/step - loss: 0.3486 - accuracy: 0.8348
Epoch 271/300
6/6 [==============================] - 0s 541us/step - loss: 0.3484 - accuracy: 0.8348
Epoch 272/300
6/6 [==============================] - 0s 537us/step - loss: 0.3482 - accuracy: 0.8348
Epoch 273/300
6/6 [==============================] - 0s 532us/step - loss: 0.3481 - accuracy: 0.8348
Epoch 274/300
6/6 [==============================] - 0s 552us/step - loss: 0.3480 - accuracy: 0.8319
Epoch 275/300
6/6 [==============================] - 0s 566us/step - loss: 0.3477 - accuracy: 0.8319
Epoch 276/300
6/6 [==============================] - 0s 540us/step - loss: 0.3475 - accuracy: 0.8348
Epoch 277/300
6/6 [==============================] - 0s 552us/step - loss: 0.3473 - accuracy: 0.8348
Epoch 278/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3473 - accuracy: 0.8348
Epoch 279/300
6/6 [==============================] - 0s 526us/step - loss: 0.3470 - accuracy: 0.8377
Epoch 280/300
6/6 [==============================] - 0s 541us/step - loss: 0.3469 - accuracy: 0.8406
Epoch 281/300
6/6 [==============================] - 0s 531us/step - loss: 0.3468 - accuracy: 0.8377
Epoch 282/300
6/6 [==============================] - 0s 536us/step - loss: 0.3468 - accuracy: 0.8406
Epoch 283/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3464 - accuracy: 0.8406
Epoch 284/300
6/6 [==============================] - 0s 584us/step - loss: 0.3462 - accuracy: 0.8377
Epoch 285/300
6/6 [==============================] - 0s 532us/step - loss: 0.3460 - accuracy: 0.8435
Epoch 286/300
6/6 [==============================] - 0s 568us/step - loss: 0.3458 - accuracy: 0.8435
Epoch 287/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3457 - accuracy: 0.8406
Epoch 288/300
6/6 [==============================] - 0s 557us/step - loss: 0.3455 - accuracy: 0.8406
Epoch 289/300
6/6 [==============================] - 0s 538us/step - loss: 0.3452 - accuracy: 0.8406
Epoch 290/300
6/6 [==============================] - 0s 541us/step - loss: 0.3451 - accuracy: 0.8435
Epoch 291/300
6/6 [==============================] - 0s 535us/step - loss: 0.3450 - accuracy: 0.8406
Epoch 292/300
6/6 [==============================] - 0s 548us/step - loss: 0.3449 - accuracy: 0.8406
Epoch 293/300
6/6 [==============================] - 0s 546us/step - loss: 0.3444 - accuracy: 0.8406
Epoch 294/300
6/6 [==============================] - 0s 551us/step - loss: 0.3443 - accuracy: 0.8406
Epoch 295/300
6/6 [==============================] - 0s 552us/step - loss: 0.3444 - accuracy: 0.8406
Epoch 296/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3441 - accuracy: 0.8406
Epoch 297/300
6/6 [==============================] - 0s 545us/step - loss: 0.3439 - accuracy: 0.8406
Epoch 298/300
6/6 [==============================] - 0s 537us/step - loss: 0.3433 - accuracy: 0.8406
Epoch 299/300
6/6 [==============================] - 0s 542us/step - loss: 0.3434 - accuracy: 0.8377
Epoch 300/300
6/6 [==============================] - 0s 530us/step - loss: 0.3433 - accuracy: 0.8377
Epoch 1/300
6/6 [==============================] - 0s 12ms/step - loss: 0.6512 - accuracy: 0.6667
Epoch 2/300
6/6 [==============================] - 0s 599us/step - loss: 0.6385 - accuracy: 0.6783
Epoch 3/300
6/6 [==============================] - 0s 616us/step - loss: 0.6274 - accuracy: 0.6899
Epoch 4/300
6/6 [==============================] - 0s 594us/step - loss: 0.6164 - accuracy: 0.6928
Epoch 5/300
6/6 [==============================] - 0s 601us/step - loss: 0.6065 - accuracy: 0.6986
Epoch 6/300
6/6 [==============================] - 0s 594us/step - loss: 0.5967 - accuracy: 0.7072
Epoch 7/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5877 - accuracy: 0.7159
Epoch 8/300
6/6 [==============================] - 0s 623us/step - loss: 0.5783 - accuracy: 0.7188
Epoch 9/300
6/6 [==============================] - 0s 603us/step - loss: 0.5710 - accuracy: 0.7217
Epoch 10/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5633 - accuracy: 0.7217
Epoch 11/300
6/6 [==============================] - 0s 625us/step - loss: 0.5562 - accuracy: 0.7275
Epoch 12/300
6/6 [==============================] - 0s 609us/step - loss: 0.5496 - accuracy: 0.7333
Epoch 13/300
6/6 [==============================] - 0s 645us/step - loss: 0.5434 - accuracy: 0.7333
Epoch 14/300
6/6 [==============================] - 0s 629us/step - loss: 0.5375 - accuracy: 0.7420
Epoch 15/300
6/6 [==============================] - 0s 721us/step - loss: 0.5321 - accuracy: 0.7449
Epoch 16/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5269 - accuracy: 0.7507
Epoch 17/300
6/6 [==============================] - 0s 619us/step - loss: 0.5221 - accuracy: 0.7478
Epoch 18/300
6/6 [==============================] - 0s 588us/step - loss: 0.5171 - accuracy: 0.7536
Epoch 19/300
6/6 [==============================] - 0s 538us/step - loss: 0.5126 - accuracy: 0.7623
Epoch 20/300
6/6 [==============================] - 0s 612us/step - loss: 0.5079 - accuracy: 0.7623
Epoch 21/300
6/6 [==============================] - 0s 551us/step - loss: 0.5042 - accuracy: 0.7681
Epoch 22/300
6/6 [==============================] - 0s 602us/step - loss: 0.5005 - accuracy: 0.7652
Epoch 23/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4968 - accuracy: 0.7652
Epoch 24/300
6/6 [==============================] - 0s 544us/step - loss: 0.4934 - accuracy: 0.7768
Epoch 25/300
6/6 [==============================] - 0s 541us/step - loss: 0.4900 - accuracy: 0.7768
Epoch 26/300
6/6 [==============================] - 0s 551us/step - loss: 0.4870 - accuracy: 0.7826
Epoch 27/300
6/6 [==============================] - 0s 560us/step - loss: 0.4843 - accuracy: 0.7826
Epoch 28/300
6/6 [==============================] - 0s 585us/step - loss: 0.4812 - accuracy: 0.7826
Epoch 29/300
6/6 [==============================] - 0s 536us/step - loss: 0.4786 - accuracy: 0.7884
Epoch 30/300
6/6 [==============================] - 0s 544us/step - loss: 0.4761 - accuracy: 0.7884
Epoch 31/300
6/6 [==============================] - 0s 564us/step - loss: 0.4741 - accuracy: 0.7913
Epoch 32/300
6/6 [==============================] - 0s 562us/step - loss: 0.4718 - accuracy: 0.7913
Epoch 33/300
6/6 [==============================] - 0s 540us/step - loss: 0.4696 - accuracy: 0.7942
Epoch 34/300
6/6 [==============================] - 0s 539us/step - loss: 0.4679 - accuracy: 0.7913
Epoch 35/300
6/6 [==============================] - 0s 518us/step - loss: 0.4658 - accuracy: 0.7913
Epoch 36/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4641 - accuracy: 0.7913
Epoch 37/300
6/6 [==============================] - 0s 532us/step - loss: 0.4625 - accuracy: 0.7913
Epoch 38/300
6/6 [==============================] - 0s 563us/step - loss: 0.4609 - accuracy: 0.7913
Epoch 39/300
6/6 [==============================] - 0s 568us/step - loss: 0.4595 - accuracy: 0.7913
Epoch 40/300
6/6 [==============================] - 0s 531us/step - loss: 0.4582 - accuracy: 0.7913
Epoch 41/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4568 - accuracy: 0.7942
Epoch 42/300
6/6 [==============================] - 0s 544us/step - loss: 0.4555 - accuracy: 0.7942
Epoch 43/300
6/6 [==============================] - 0s 529us/step - loss: 0.4543 - accuracy: 0.7913
Epoch 44/300
6/6 [==============================] - 0s 516us/step - loss: 0.4532 - accuracy: 0.7971
Epoch 45/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4519 - accuracy: 0.7942
Epoch 46/300
6/6 [==============================] - 0s 558us/step - loss: 0.4508 - accuracy: 0.7971
Epoch 47/300
6/6 [==============================] - 0s 540us/step - loss: 0.4497 - accuracy: 0.7971
Epoch 48/300
6/6 [==============================] - 0s 535us/step - loss: 0.4487 - accuracy: 0.7971
Epoch 49/300
6/6 [==============================] - 0s 527us/step - loss: 0.4476 - accuracy: 0.7971
Epoch 50/300
6/6 [==============================] - 0s 542us/step - loss: 0.4466 - accuracy: 0.8000
Epoch 51/300
6/6 [==============================] - 0s 529us/step - loss: 0.4457 - accuracy: 0.8000
Epoch 52/300
6/6 [==============================] - 0s 534us/step - loss: 0.4446 - accuracy: 0.8029
Epoch 53/300
6/6 [==============================] - 0s 534us/step - loss: 0.4437 - accuracy: 0.8029
Epoch 54/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4429 - accuracy: 0.8029
Epoch 55/300
6/6 [==============================] - 0s 550us/step - loss: 0.4419 - accuracy: 0.8058
Epoch 56/300
6/6 [==============================] - 0s 529us/step - loss: 0.4412 - accuracy: 0.8058
Epoch 57/300
6/6 [==============================] - 0s 532us/step - loss: 0.4402 - accuracy: 0.8058
Epoch 58/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4392 - accuracy: 0.8058
Epoch 59/300
6/6 [==============================] - 0s 575us/step - loss: 0.4382 - accuracy: 0.8058
Epoch 60/300
6/6 [==============================] - 0s 549us/step - loss: 0.4372 - accuracy: 0.8029
Epoch 61/300
6/6 [==============================] - 0s 533us/step - loss: 0.4363 - accuracy: 0.8116
Epoch 62/300
6/6 [==============================] - 0s 554us/step - loss: 0.4354 - accuracy: 0.8087
Epoch 63/300
6/6 [==============================] - 0s 560us/step - loss: 0.4347 - accuracy: 0.8087
Epoch 64/300
6/6 [==============================] - 0s 548us/step - loss: 0.4337 - accuracy: 0.8116
Epoch 65/300
6/6 [==============================] - 0s 563us/step - loss: 0.4331 - accuracy: 0.8087
Epoch 66/300
6/6 [==============================] - 0s 561us/step - loss: 0.4324 - accuracy: 0.8087
Epoch 67/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4317 - accuracy: 0.8116
Epoch 68/300
6/6 [==============================] - 0s 571us/step - loss: 0.4309 - accuracy: 0.8145
Epoch 69/300
6/6 [==============================] - 0s 558us/step - loss: 0.4303 - accuracy: 0.8145
Epoch 70/300
6/6 [==============================] - 0s 549us/step - loss: 0.4296 - accuracy: 0.8116
Epoch 71/300
6/6 [==============================] - 0s 532us/step - loss: 0.4290 - accuracy: 0.8145
Epoch 72/300
6/6 [==============================] - 0s 556us/step - loss: 0.4283 - accuracy: 0.8145
Epoch 73/300
6/6 [==============================] - 0s 552us/step - loss: 0.4274 - accuracy: 0.8145
Epoch 74/300
6/6 [==============================] - 0s 597us/step - loss: 0.4268 - accuracy: 0.8116
Epoch 75/300
6/6 [==============================] - 0s 529us/step - loss: 0.4261 - accuracy: 0.8116
Epoch 76/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4256 - accuracy: 0.8116
Epoch 77/300
6/6 [==============================] - 0s 596us/step - loss: 0.4249 - accuracy: 0.8116
Epoch 78/300
6/6 [==============================] - 0s 608us/step - loss: 0.4239 - accuracy: 0.8116
Epoch 79/300
6/6 [==============================] - 0s 617us/step - loss: 0.4232 - accuracy: 0.8145
Epoch 80/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4225 - accuracy: 0.8145
Epoch 81/300
6/6 [==============================] - 0s 585us/step - loss: 0.4216 - accuracy: 0.8145
Epoch 82/300
6/6 [==============================] - 0s 584us/step - loss: 0.4209 - accuracy: 0.8116
Epoch 83/300
6/6 [==============================] - 0s 591us/step - loss: 0.4204 - accuracy: 0.8116
Epoch 84/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4195 - accuracy: 0.8087
Epoch 85/300
6/6 [==============================] - 0s 573us/step - loss: 0.4189 - accuracy: 0.8145
Epoch 86/300
6/6 [==============================] - 0s 604us/step - loss: 0.4184 - accuracy: 0.8145
Epoch 87/300
6/6 [==============================] - 0s 589us/step - loss: 0.4175 - accuracy: 0.8145
Epoch 88/300
6/6 [==============================] - 0s 590us/step - loss: 0.4172 - accuracy: 0.8116
Epoch 89/300
6/6 [==============================] - 0s 594us/step - loss: 0.4161 - accuracy: 0.8087
Epoch 90/300
6/6 [==============================] - 0s 583us/step - loss: 0.4155 - accuracy: 0.8087
Epoch 91/300
6/6 [==============================] - 0s 599us/step - loss: 0.4148 - accuracy: 0.8058
Epoch 92/300
6/6 [==============================] - 0s 593us/step - loss: 0.4142 - accuracy: 0.8087
Epoch 93/300
6/6 [==============================] - 0s 604us/step - loss: 0.4136 - accuracy: 0.8087
Epoch 94/300
6/6 [==============================] - 0s 591us/step - loss: 0.4131 - accuracy: 0.8116
Epoch 95/300
6/6 [==============================] - 0s 584us/step - loss: 0.4124 - accuracy: 0.8145
Epoch 96/300
6/6 [==============================] - 0s 574us/step - loss: 0.4118 - accuracy: 0.8145
Epoch 97/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4113 - accuracy: 0.8145
Epoch 98/300
6/6 [==============================] - 0s 590us/step - loss: 0.4107 - accuracy: 0.8116
Epoch 99/300
6/6 [==============================] - 0s 586us/step - loss: 0.4102 - accuracy: 0.8087
Epoch 100/300
6/6 [==============================] - 0s 587us/step - loss: 0.4097 - accuracy: 0.8116
Epoch 101/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4091 - accuracy: 0.8087
Epoch 102/300
6/6 [==============================] - 0s 594us/step - loss: 0.4085 - accuracy: 0.8087
Epoch 103/300
6/6 [==============================] - 0s 579us/step - loss: 0.4082 - accuracy: 0.8087
Epoch 104/300
6/6 [==============================] - 0s 585us/step - loss: 0.4076 - accuracy: 0.8087
Epoch 105/300
6/6 [==============================] - 0s 580us/step - loss: 0.4070 - accuracy: 0.8087
Epoch 106/300
6/6 [==============================] - 0s 616us/step - loss: 0.4065 - accuracy: 0.8087
Epoch 107/300
6/6 [==============================] - 0s 603us/step - loss: 0.4061 - accuracy: 0.8087
Epoch 108/300
6/6 [==============================] - 0s 587us/step - loss: 0.4055 - accuracy: 0.8087
Epoch 109/300
6/6 [==============================] - 0s 603us/step - loss: 0.4054 - accuracy: 0.8058
Epoch 110/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4044 - accuracy: 0.8087
Epoch 111/300
6/6 [==============================] - 0s 588us/step - loss: 0.4041 - accuracy: 0.8087
Epoch 112/300
6/6 [==============================] - 0s 593us/step - loss: 0.4036 - accuracy: 0.8058
Epoch 113/300
6/6 [==============================] - 0s 590us/step - loss: 0.4031 - accuracy: 0.8058
Epoch 114/300
6/6 [==============================] - 0s 596us/step - loss: 0.4027 - accuracy: 0.8058
Epoch 115/300
6/6 [==============================] - 0s 594us/step - loss: 0.4024 - accuracy: 0.8058
Epoch 116/300
6/6 [==============================] - 0s 580us/step - loss: 0.4018 - accuracy: 0.8029
Epoch 117/300
6/6 [==============================] - 0s 593us/step - loss: 0.4015 - accuracy: 0.8029
Epoch 118/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4008 - accuracy: 0.8058
Epoch 119/300
6/6 [==============================] - 0s 608us/step - loss: 0.4004 - accuracy: 0.8058
Epoch 120/300
6/6 [==============================] - 0s 601us/step - loss: 0.4001 - accuracy: 0.8058
Epoch 121/300
6/6 [==============================] - 0s 579us/step - loss: 0.3995 - accuracy: 0.8058
Epoch 122/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3991 - accuracy: 0.8058
Epoch 123/300
6/6 [==============================] - 0s 599us/step - loss: 0.3987 - accuracy: 0.8058
Epoch 124/300
6/6 [==============================] - 0s 600us/step - loss: 0.3983 - accuracy: 0.8058
Epoch 125/300
6/6 [==============================] - 0s 594us/step - loss: 0.3977 - accuracy: 0.8058
Epoch 126/300
6/6 [==============================] - 0s 581us/step - loss: 0.3973 - accuracy: 0.8058
Epoch 127/300
6/6 [==============================] - 0s 608us/step - loss: 0.3969 - accuracy: 0.8058
Epoch 128/300
6/6 [==============================] - 0s 587us/step - loss: 0.3964 - accuracy: 0.8058
Epoch 129/300
6/6 [==============================] - 0s 601us/step - loss: 0.3961 - accuracy: 0.8058
Epoch 130/300
6/6 [==============================] - 0s 589us/step - loss: 0.3958 - accuracy: 0.8087
Epoch 131/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3953 - accuracy: 0.8087
Epoch 132/300
6/6 [==============================] - 0s 573us/step - loss: 0.3945 - accuracy: 0.8058
Epoch 133/300
6/6 [==============================] - 0s 577us/step - loss: 0.3944 - accuracy: 0.8058
Epoch 134/300
6/6 [==============================] - 0s 585us/step - loss: 0.3939 - accuracy: 0.8058
Epoch 135/300
6/6 [==============================] - 0s 578us/step - loss: 0.3934 - accuracy: 0.8058
Epoch 136/300
6/6 [==============================] - 0s 613us/step - loss: 0.3928 - accuracy: 0.8116
Epoch 137/300
6/6 [==============================] - 0s 584us/step - loss: 0.3923 - accuracy: 0.8087
Epoch 138/300
6/6 [==============================] - 0s 598us/step - loss: 0.3919 - accuracy: 0.8087
Epoch 139/300
6/6 [==============================] - 0s 584us/step - loss: 0.3914 - accuracy: 0.8087
Epoch 140/300
6/6 [==============================] - 0s 685us/step - loss: 0.3908 - accuracy: 0.8087
Epoch 141/300
6/6 [==============================] - 0s 572us/step - loss: 0.3903 - accuracy: 0.8087
Epoch 142/300
6/6 [==============================] - 0s 588us/step - loss: 0.3897 - accuracy: 0.8087
Epoch 143/300
6/6 [==============================] - 0s 580us/step - loss: 0.3891 - accuracy: 0.8087
Epoch 144/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3886 - accuracy: 0.8087
Epoch 145/300
6/6 [==============================] - 0s 599us/step - loss: 0.3880 - accuracy: 0.8116
Epoch 146/300
6/6 [==============================] - 0s 590us/step - loss: 0.3875 - accuracy: 0.8116
Epoch 147/300
6/6 [==============================] - 0s 596us/step - loss: 0.3868 - accuracy: 0.8116
Epoch 148/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3863 - accuracy: 0.8116
Epoch 149/300
6/6 [==============================] - 0s 602us/step - loss: 0.3856 - accuracy: 0.8087
Epoch 150/300
6/6 [==============================] - 0s 596us/step - loss: 0.3852 - accuracy: 0.8087
Epoch 151/300
6/6 [==============================] - 0s 562us/step - loss: 0.3848 - accuracy: 0.8087
Epoch 152/300
6/6 [==============================] - 0s 593us/step - loss: 0.3845 - accuracy: 0.8116
Epoch 153/300
6/6 [==============================] - 0s 591us/step - loss: 0.3839 - accuracy: 0.8145
Epoch 154/300
6/6 [==============================] - 0s 608us/step - loss: 0.3835 - accuracy: 0.8116
Epoch 155/300
6/6 [==============================] - 0s 588us/step - loss: 0.3832 - accuracy: 0.8087
Epoch 156/300
6/6 [==============================] - 0s 593us/step - loss: 0.3826 - accuracy: 0.8087
Epoch 157/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3821 - accuracy: 0.8116
Epoch 158/300
6/6 [==============================] - 0s 598us/step - loss: 0.3819 - accuracy: 0.8116
Epoch 159/300
6/6 [==============================] - 0s 591us/step - loss: 0.3815 - accuracy: 0.8145
Epoch 160/300
6/6 [==============================] - 0s 577us/step - loss: 0.3811 - accuracy: 0.8145
Epoch 161/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3807 - accuracy: 0.8174
Epoch 162/300
6/6 [==============================] - 0s 603us/step - loss: 0.3803 - accuracy: 0.8174
Epoch 163/300
6/6 [==============================] - 0s 568us/step - loss: 0.3799 - accuracy: 0.8174
Epoch 164/300
6/6 [==============================] - 0s 595us/step - loss: 0.3795 - accuracy: 0.8174
Epoch 165/300
6/6 [==============================] - 0s 577us/step - loss: 0.3792 - accuracy: 0.8174
Epoch 166/300
6/6 [==============================] - 0s 586us/step - loss: 0.3787 - accuracy: 0.8174
Epoch 167/300
6/6 [==============================] - 0s 599us/step - loss: 0.3784 - accuracy: 0.8174
Epoch 168/300
6/6 [==============================] - 0s 564us/step - loss: 0.3782 - accuracy: 0.8174
Epoch 169/300
6/6 [==============================] - 0s 577us/step - loss: 0.3777 - accuracy: 0.8203
Epoch 170/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3778 - accuracy: 0.8203
Epoch 171/300
6/6 [==============================] - 0s 589us/step - loss: 0.3772 - accuracy: 0.8232
Epoch 172/300
6/6 [==============================] - 0s 621us/step - loss: 0.3771 - accuracy: 0.8232
Epoch 173/300
6/6 [==============================] - 0s 604us/step - loss: 0.3764 - accuracy: 0.8232
Epoch 174/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3764 - accuracy: 0.8232
Epoch 175/300
6/6 [==============================] - 0s 603us/step - loss: 0.3759 - accuracy: 0.8232
Epoch 176/300
6/6 [==============================] - 0s 619us/step - loss: 0.3756 - accuracy: 0.8261
Epoch 177/300
6/6 [==============================] - 0s 586us/step - loss: 0.3754 - accuracy: 0.8261
Epoch 178/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3753 - accuracy: 0.8261
Epoch 179/300
6/6 [==============================] - 0s 595us/step - loss: 0.3748 - accuracy: 0.8261
Epoch 180/300
6/6 [==============================] - 0s 596us/step - loss: 0.3746 - accuracy: 0.8261
Epoch 181/300
6/6 [==============================] - 0s 605us/step - loss: 0.3743 - accuracy: 0.8290
Epoch 182/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3740 - accuracy: 0.8290
Epoch 183/300
6/6 [==============================] - 0s 600us/step - loss: 0.3739 - accuracy: 0.8290
Epoch 184/300
6/6 [==============================] - 0s 623us/step - loss: 0.3733 - accuracy: 0.8290
Epoch 185/300
6/6 [==============================] - 0s 593us/step - loss: 0.3731 - accuracy: 0.8261
Epoch 186/300
6/6 [==============================] - 0s 612us/step - loss: 0.3731 - accuracy: 0.8261
Epoch 187/300
6/6 [==============================] - 0s 615us/step - loss: 0.3728 - accuracy: 0.8232
Epoch 188/300
6/6 [==============================] - 0s 599us/step - loss: 0.3724 - accuracy: 0.8232
Epoch 189/300
6/6 [==============================] - 0s 583us/step - loss: 0.3720 - accuracy: 0.8261
Epoch 190/300
6/6 [==============================] - 0s 582us/step - loss: 0.3718 - accuracy: 0.8261
Epoch 191/300
6/6 [==============================] - 0s 593us/step - loss: 0.3715 - accuracy: 0.8261
Epoch 192/300
6/6 [==============================] - 0s 593us/step - loss: 0.3713 - accuracy: 0.8261
Epoch 193/300
6/6 [==============================] - 0s 585us/step - loss: 0.3709 - accuracy: 0.8261
Epoch 194/300
6/6 [==============================] - 0s 579us/step - loss: 0.3708 - accuracy: 0.8261
Epoch 195/300
6/6 [==============================] - 0s 637us/step - loss: 0.3704 - accuracy: 0.8290
Epoch 196/300
6/6 [==============================] - 0s 613us/step - loss: 0.3702 - accuracy: 0.8261
Epoch 197/300
6/6 [==============================] - 0s 583us/step - loss: 0.3700 - accuracy: 0.8261
Epoch 198/300
6/6 [==============================] - 0s 596us/step - loss: 0.3695 - accuracy: 0.8261
Epoch 199/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3691 - accuracy: 0.8261
Epoch 200/300
6/6 [==============================] - 0s 597us/step - loss: 0.3690 - accuracy: 0.8261
Epoch 201/300
6/6 [==============================] - 0s 605us/step - loss: 0.3688 - accuracy: 0.8261
Epoch 202/300
6/6 [==============================] - 0s 599us/step - loss: 0.3685 - accuracy: 0.8261
Epoch 203/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3682 - accuracy: 0.8261
Epoch 204/300
6/6 [==============================] - 0s 605us/step - loss: 0.3678 - accuracy: 0.8261
Epoch 205/300
6/6 [==============================] - 0s 615us/step - loss: 0.3676 - accuracy: 0.8261
Epoch 206/300
6/6 [==============================] - 0s 624us/step - loss: 0.3675 - accuracy: 0.8261
Epoch 207/300
6/6 [==============================] - 0s 625us/step - loss: 0.3670 - accuracy: 0.8261
Epoch 208/300
6/6 [==============================] - 0s 592us/step - loss: 0.3669 - accuracy: 0.8261
Epoch 209/300
6/6 [==============================] - 0s 597us/step - loss: 0.3665 - accuracy: 0.8261
Epoch 210/300
6/6 [==============================] - 0s 615us/step - loss: 0.3662 - accuracy: 0.8261
Epoch 211/300
6/6 [==============================] - 0s 613us/step - loss: 0.3658 - accuracy: 0.8261
Epoch 212/300
6/6 [==============================] - 0s 596us/step - loss: 0.3656 - accuracy: 0.8261
Epoch 213/300
6/6 [==============================] - 0s 642us/step - loss: 0.3655 - accuracy: 0.8261
Epoch 214/300
6/6 [==============================] - 0s 581us/step - loss: 0.3652 - accuracy: 0.8261
Epoch 215/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3649 - accuracy: 0.8232
Epoch 216/300
6/6 [==============================] - 0s 634us/step - loss: 0.3648 - accuracy: 0.8261
Epoch 217/300
6/6 [==============================] - 0s 592us/step - loss: 0.3643 - accuracy: 0.8261
Epoch 218/300
6/6 [==============================] - 0s 586us/step - loss: 0.3644 - accuracy: 0.8232
Epoch 219/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3638 - accuracy: 0.8232
Epoch 220/300
6/6 [==============================] - 0s 612us/step - loss: 0.3636 - accuracy: 0.8261
Epoch 221/300
6/6 [==============================] - 0s 602us/step - loss: 0.3633 - accuracy: 0.8261
Epoch 222/300
6/6 [==============================] - 0s 594us/step - loss: 0.3630 - accuracy: 0.8261
Epoch 223/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3628 - accuracy: 0.8261
Epoch 224/300
6/6 [==============================] - 0s 594us/step - loss: 0.3626 - accuracy: 0.8261
Epoch 225/300
6/6 [==============================] - 0s 604us/step - loss: 0.3624 - accuracy: 0.8232
Epoch 226/300
6/6 [==============================] - 0s 584us/step - loss: 0.3621 - accuracy: 0.8232
Epoch 227/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3620 - accuracy: 0.8232
Epoch 228/300
6/6 [==============================] - 0s 617us/step - loss: 0.3617 - accuracy: 0.8232
Epoch 229/300
6/6 [==============================] - 0s 592us/step - loss: 0.3614 - accuracy: 0.8232
Epoch 230/300
6/6 [==============================] - 0s 639us/step - loss: 0.3614 - accuracy: 0.8232
Epoch 231/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3608 - accuracy: 0.8232
Epoch 232/300
6/6 [==============================] - 0s 601us/step - loss: 0.3606 - accuracy: 0.8261
Epoch 233/300
6/6 [==============================] - 0s 587us/step - loss: 0.3605 - accuracy: 0.8232
Epoch 234/300
6/6 [==============================] - 0s 585us/step - loss: 0.3602 - accuracy: 0.8232
Epoch 235/300
6/6 [==============================] - 0s 603us/step - loss: 0.3601 - accuracy: 0.8232
Epoch 236/300
6/6 [==============================] - 0s 592us/step - loss: 0.3598 - accuracy: 0.8232
Epoch 237/300
6/6 [==============================] - 0s 591us/step - loss: 0.3599 - accuracy: 0.8232
Epoch 238/300
6/6 [==============================] - 0s 590us/step - loss: 0.3595 - accuracy: 0.8232
Epoch 239/300
6/6 [==============================] - 0s 601us/step - loss: 0.3590 - accuracy: 0.8261
Epoch 240/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3589 - accuracy: 0.8261
Epoch 241/300
6/6 [==============================] - 0s 606us/step - loss: 0.3588 - accuracy: 0.8232
Epoch 242/300
6/6 [==============================] - 0s 597us/step - loss: 0.3585 - accuracy: 0.8232
Epoch 243/300
6/6 [==============================] - 0s 599us/step - loss: 0.3582 - accuracy: 0.8232
Epoch 244/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3582 - accuracy: 0.8232
Epoch 245/300
6/6 [==============================] - 0s 589us/step - loss: 0.3578 - accuracy: 0.8232
Epoch 246/300
6/6 [==============================] - 0s 599us/step - loss: 0.3578 - accuracy: 0.8290
Epoch 247/300
6/6 [==============================] - 0s 574us/step - loss: 0.3575 - accuracy: 0.8261
Epoch 248/300
6/6 [==============================] - 0s 582us/step - loss: 0.3572 - accuracy: 0.8261
Epoch 249/300
6/6 [==============================] - 0s 600us/step - loss: 0.3571 - accuracy: 0.8319
Epoch 250/300
6/6 [==============================] - 0s 605us/step - loss: 0.3568 - accuracy: 0.8319
Epoch 251/300
6/6 [==============================] - 0s 588us/step - loss: 0.3565 - accuracy: 0.8290
Epoch 252/300
6/6 [==============================] - 0s 588us/step - loss: 0.3563 - accuracy: 0.8290
Epoch 253/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3560 - accuracy: 0.8290
Epoch 254/300
6/6 [==============================] - 0s 598us/step - loss: 0.3559 - accuracy: 0.8319
Epoch 255/300
6/6 [==============================] - 0s 580us/step - loss: 0.3558 - accuracy: 0.8290
Epoch 256/300
6/6 [==============================] - 0s 593us/step - loss: 0.3554 - accuracy: 0.8290
Epoch 257/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3553 - accuracy: 0.8290
Epoch 258/300
6/6 [==============================] - 0s 599us/step - loss: 0.3551 - accuracy: 0.8319
Epoch 259/300
6/6 [==============================] - 0s 592us/step - loss: 0.3549 - accuracy: 0.8319
Epoch 260/300
6/6 [==============================] - 0s 603us/step - loss: 0.3547 - accuracy: 0.8319
Epoch 261/300
6/6 [==============================] - 0s 574us/step - loss: 0.3544 - accuracy: 0.8319
Epoch 262/300
6/6 [==============================] - 0s 606us/step - loss: 0.3542 - accuracy: 0.8319
Epoch 263/300
6/6 [==============================] - 0s 605us/step - loss: 0.3541 - accuracy: 0.8319
Epoch 264/300
6/6 [==============================] - 0s 567us/step - loss: 0.3538 - accuracy: 0.8319
Epoch 265/300
6/6 [==============================] - 0s 583us/step - loss: 0.3539 - accuracy: 0.8319
Epoch 266/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3536 - accuracy: 0.8319
Epoch 267/300
6/6 [==============================] - 0s 576us/step - loss: 0.3532 - accuracy: 0.8319
Epoch 268/300
6/6 [==============================] - 0s 556us/step - loss: 0.3530 - accuracy: 0.8319
Epoch 269/300
6/6 [==============================] - 0s 557us/step - loss: 0.3528 - accuracy: 0.8319
Epoch 270/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3527 - accuracy: 0.8319
Epoch 271/300
6/6 [==============================] - 0s 587us/step - loss: 0.3524 - accuracy: 0.8319
Epoch 272/300
6/6 [==============================] - 0s 585us/step - loss: 0.3520 - accuracy: 0.8319
Epoch 273/300
6/6 [==============================] - 0s 591us/step - loss: 0.3520 - accuracy: 0.8319
Epoch 274/300
6/6 [==============================] - 0s 571us/step - loss: 0.3517 - accuracy: 0.8319
Epoch 275/300
6/6 [==============================] - 0s 576us/step - loss: 0.3514 - accuracy: 0.8319
Epoch 276/300
6/6 [==============================] - 0s 599us/step - loss: 0.3513 - accuracy: 0.8319
Epoch 277/300
6/6 [==============================] - 0s 583us/step - loss: 0.3517 - accuracy: 0.8319
Epoch 278/300
6/6 [==============================] - 0s 600us/step - loss: 0.3508 - accuracy: 0.8319
Epoch 279/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3506 - accuracy: 0.8319
Epoch 280/300
6/6 [==============================] - 0s 584us/step - loss: 0.3504 - accuracy: 0.8319
Epoch 281/300
6/6 [==============================] - 0s 586us/step - loss: 0.3502 - accuracy: 0.8319
Epoch 282/300
6/6 [==============================] - 0s 597us/step - loss: 0.3500 - accuracy: 0.8319
Epoch 283/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3498 - accuracy: 0.8319
Epoch 284/300
6/6 [==============================] - 0s 581us/step - loss: 0.3499 - accuracy: 0.8319
Epoch 285/300
6/6 [==============================] - 0s 600us/step - loss: 0.3496 - accuracy: 0.8319
Epoch 286/300
6/6 [==============================] - 0s 617us/step - loss: 0.3491 - accuracy: 0.8319
Epoch 287/300
6/6 [==============================] - 0s 576us/step - loss: 0.3489 - accuracy: 0.8319
Epoch 288/300
6/6 [==============================] - 0s 597us/step - loss: 0.3487 - accuracy: 0.8290
Epoch 289/300
6/6 [==============================] - 0s 577us/step - loss: 0.3485 - accuracy: 0.8319
Epoch 290/300
6/6 [==============================] - 0s 598us/step - loss: 0.3482 - accuracy: 0.8319
Epoch 291/300
6/6 [==============================] - 0s 600us/step - loss: 0.3480 - accuracy: 0.8319
Epoch 292/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3482 - accuracy: 0.8319
Epoch 293/300
6/6 [==============================] - 0s 584us/step - loss: 0.3479 - accuracy: 0.8319
Epoch 294/300
6/6 [==============================] - 0s 590us/step - loss: 0.3477 - accuracy: 0.8319
Epoch 295/300
6/6 [==============================] - 0s 569us/step - loss: 0.3473 - accuracy: 0.8319
Epoch 296/300
6/6 [==============================] - 0s 566us/step - loss: 0.3471 - accuracy: 0.8319
Epoch 297/300
6/6 [==============================] - 0s 585us/step - loss: 0.3468 - accuracy: 0.8290
Epoch 298/300
6/6 [==============================] - 0s 593us/step - loss: 0.3467 - accuracy: 0.8290
Epoch 299/300
6/6 [==============================] - 0s 594us/step - loss: 0.3465 - accuracy: 0.8290
Epoch 300/300
6/6 [==============================] - 0s 573us/step - loss: 0.3462 - accuracy: 0.8290
Epoch 1/300
6/6 [==============================] - 0s 726us/step - loss: 0.6449 - accuracy: 0.6783
Epoch 2/300
6/6 [==============================] - 0s 12ms/step - loss: 0.6319 - accuracy: 0.6870
Epoch 3/300
6/6 [==============================] - 0s 648us/step - loss: 0.6196 - accuracy: 0.6957
Epoch 4/300
6/6 [==============================] - 0s 674us/step - loss: 0.6080 - accuracy: 0.6957
Epoch 5/300
6/6 [==============================] - 0s 15ms/step - loss: 0.5965 - accuracy: 0.7043
Epoch 6/300
6/6 [==============================] - 0s 583us/step - loss: 0.5857 - accuracy: 0.7043
Epoch 7/300
6/6 [==============================] - 0s 641us/step - loss: 0.5759 - accuracy: 0.7043
Epoch 8/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5657 - accuracy: 0.7130
Epoch 9/300
6/6 [==============================] - 0s 635us/step - loss: 0.5571 - accuracy: 0.7159
Epoch 10/300
6/6 [==============================] - 0s 618us/step - loss: 0.5483 - accuracy: 0.7217
Epoch 11/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5403 - accuracy: 0.7217
Epoch 12/300
6/6 [==============================] - 0s 631us/step - loss: 0.5331 - accuracy: 0.7246
Epoch 13/300
6/6 [==============================] - 0s 635us/step - loss: 0.5262 - accuracy: 0.7246
Epoch 14/300
6/6 [==============================] - 0s 642us/step - loss: 0.5199 - accuracy: 0.7275
Epoch 15/300
6/6 [==============================] - 0s 632us/step - loss: 0.5140 - accuracy: 0.7275
Epoch 16/300
6/6 [==============================] - 0s 553us/step - loss: 0.5084 - accuracy: 0.7362
Epoch 17/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5031 - accuracy: 0.7420
Epoch 18/300
6/6 [==============================] - 0s 602us/step - loss: 0.4980 - accuracy: 0.7478
Epoch 19/300
6/6 [==============================] - 0s 621us/step - loss: 0.4929 - accuracy: 0.7565
Epoch 20/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4886 - accuracy: 0.7565
Epoch 21/300
6/6 [==============================] - 0s 670us/step - loss: 0.4840 - accuracy: 0.7623
Epoch 22/300
6/6 [==============================] - 0s 557us/step - loss: 0.4797 - accuracy: 0.7681
Epoch 23/300
6/6 [==============================] - 0s 567us/step - loss: 0.4760 - accuracy: 0.7710
Epoch 24/300
6/6 [==============================] - 0s 612us/step - loss: 0.4725 - accuracy: 0.7739
Epoch 25/300
6/6 [==============================] - 0s 570us/step - loss: 0.4690 - accuracy: 0.7768
Epoch 26/300
6/6 [==============================] - 0s 572us/step - loss: 0.4661 - accuracy: 0.7797
Epoch 27/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4633 - accuracy: 0.7826
Epoch 28/300
6/6 [==============================] - 0s 593us/step - loss: 0.4607 - accuracy: 0.7797
Epoch 29/300
6/6 [==============================] - 0s 592us/step - loss: 0.4582 - accuracy: 0.7826
Epoch 30/300
6/6 [==============================] - 0s 586us/step - loss: 0.4556 - accuracy: 0.7855
Epoch 31/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4532 - accuracy: 0.7884
Epoch 32/300
6/6 [==============================] - 0s 583us/step - loss: 0.4514 - accuracy: 0.7884
Epoch 33/300
6/6 [==============================] - 0s 577us/step - loss: 0.4490 - accuracy: 0.7971
Epoch 34/300
6/6 [==============================] - 0s 567us/step - loss: 0.4470 - accuracy: 0.8000
Epoch 35/300
6/6 [==============================] - 0s 550us/step - loss: 0.4447 - accuracy: 0.8000
Epoch 36/300
6/6 [==============================] - 0s 640us/step - loss: 0.4429 - accuracy: 0.8000
Epoch 37/300
6/6 [==============================] - 0s 596us/step - loss: 0.4411 - accuracy: 0.7971
Epoch 38/300
6/6 [==============================] - 0s 584us/step - loss: 0.4397 - accuracy: 0.7971
Epoch 39/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4378 - accuracy: 0.7971
Epoch 40/300
6/6 [==============================] - 0s 599us/step - loss: 0.4365 - accuracy: 0.7971
Epoch 41/300
6/6 [==============================] - 0s 575us/step - loss: 0.4349 - accuracy: 0.7971
Epoch 42/300
6/6 [==============================] - 0s 551us/step - loss: 0.4337 - accuracy: 0.8000
Epoch 43/300
6/6 [==============================] - 0s 569us/step - loss: 0.4326 - accuracy: 0.8029
Epoch 44/300
6/6 [==============================] - 0s 620us/step - loss: 0.4312 - accuracy: 0.8087
Epoch 45/300
6/6 [==============================] - 0s 606us/step - loss: 0.4301 - accuracy: 0.8087
Epoch 46/300
6/6 [==============================] - 0s 579us/step - loss: 0.4290 - accuracy: 0.8087
Epoch 47/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4277 - accuracy: 0.8116
Epoch 48/300
6/6 [==============================] - 0s 576us/step - loss: 0.4266 - accuracy: 0.8145
Epoch 49/300
6/6 [==============================] - 0s 568us/step - loss: 0.4255 - accuracy: 0.8174
Epoch 50/300
6/6 [==============================] - 0s 563us/step - loss: 0.4246 - accuracy: 0.8145
Epoch 51/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4238 - accuracy: 0.8145
Epoch 52/300
6/6 [==============================] - 0s 585us/step - loss: 0.4231 - accuracy: 0.8145
Epoch 53/300
6/6 [==============================] - 0s 596us/step - loss: 0.4221 - accuracy: 0.8145
Epoch 54/300
6/6 [==============================] - 0s 573us/step - loss: 0.4214 - accuracy: 0.8116
Epoch 55/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4205 - accuracy: 0.8116
Epoch 56/300
6/6 [==============================] - 0s 598us/step - loss: 0.4197 - accuracy: 0.8116
Epoch 57/300
6/6 [==============================] - 0s 576us/step - loss: 0.4189 - accuracy: 0.8116
Epoch 58/300
6/6 [==============================] - 0s 535us/step - loss: 0.4182 - accuracy: 0.8145
Epoch 59/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4173 - accuracy: 0.8145
Epoch 60/300
6/6 [==============================] - 0s 595us/step - loss: 0.4166 - accuracy: 0.8145
Epoch 61/300
6/6 [==============================] - 0s 583us/step - loss: 0.4160 - accuracy: 0.8145
Epoch 62/300
6/6 [==============================] - 0s 568us/step - loss: 0.4152 - accuracy: 0.8116
Epoch 63/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4143 - accuracy: 0.8087
Epoch 64/300
6/6 [==============================] - 0s 595us/step - loss: 0.4137 - accuracy: 0.8087
Epoch 65/300
6/6 [==============================] - 0s 560us/step - loss: 0.4132 - accuracy: 0.8087
Epoch 66/300
6/6 [==============================] - 0s 549us/step - loss: 0.4123 - accuracy: 0.8087
Epoch 67/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4119 - accuracy: 0.8029
Epoch 68/300
6/6 [==============================] - 0s 565us/step - loss: 0.4110 - accuracy: 0.8058
Epoch 69/300
6/6 [==============================] - 0s 537us/step - loss: 0.4103 - accuracy: 0.8029
Epoch 70/300
6/6 [==============================] - 0s 554us/step - loss: 0.4097 - accuracy: 0.8029
Epoch 71/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4090 - accuracy: 0.8029
Epoch 72/300
6/6 [==============================] - 0s 579us/step - loss: 0.4085 - accuracy: 0.8029
Epoch 73/300
6/6 [==============================] - 0s 565us/step - loss: 0.4079 - accuracy: 0.8058
Epoch 74/300
6/6 [==============================] - 0s 575us/step - loss: 0.4074 - accuracy: 0.8087
Epoch 75/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4069 - accuracy: 0.8029
Epoch 76/300
6/6 [==============================] - 0s 580us/step - loss: 0.4064 - accuracy: 0.8029
Epoch 77/300
6/6 [==============================] - 0s 577us/step - loss: 0.4058 - accuracy: 0.8058
Epoch 78/300
6/6 [==============================] - 0s 564us/step - loss: 0.4053 - accuracy: 0.8087
Epoch 79/300
6/6 [==============================] - 0s 587us/step - loss: 0.4047 - accuracy: 0.8116
Epoch 80/300
6/6 [==============================] - 0s 556us/step - loss: 0.4043 - accuracy: 0.8116
Epoch 81/300
6/6 [==============================] - 0s 557us/step - loss: 0.4038 - accuracy: 0.8116
Epoch 82/300
6/6 [==============================] - 0s 552us/step - loss: 0.4034 - accuracy: 0.8116
Epoch 83/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4031 - accuracy: 0.8116
Epoch 84/300
6/6 [==============================] - 0s 604us/step - loss: 0.4026 - accuracy: 0.8116
Epoch 85/300
6/6 [==============================] - 0s 557us/step - loss: 0.4022 - accuracy: 0.8116
Epoch 86/300
6/6 [==============================] - 0s 550us/step - loss: 0.4018 - accuracy: 0.8087
Epoch 87/300
6/6 [==============================] - 0s 561us/step - loss: 0.4012 - accuracy: 0.8087
Epoch 88/300
6/6 [==============================] - 0s 566us/step - loss: 0.4010 - accuracy: 0.8087
Epoch 89/300
6/6 [==============================] - 0s 564us/step - loss: 0.4005 - accuracy: 0.8087
Epoch 90/300
6/6 [==============================] - 0s 565us/step - loss: 0.4000 - accuracy: 0.8087
Epoch 91/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3999 - accuracy: 0.8087
Epoch 92/300
6/6 [==============================] - 0s 578us/step - loss: 0.3996 - accuracy: 0.8087
Epoch 93/300
6/6 [==============================] - 0s 561us/step - loss: 0.3993 - accuracy: 0.8087
Epoch 94/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3990 - accuracy: 0.8087
Epoch 95/300
6/6 [==============================] - 0s 579us/step - loss: 0.3989 - accuracy: 0.8087
Epoch 96/300
6/6 [==============================] - 0s 561us/step - loss: 0.3985 - accuracy: 0.8087
Epoch 97/300
6/6 [==============================] - 0s 551us/step - loss: 0.3980 - accuracy: 0.8087
Epoch 98/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3977 - accuracy: 0.8087
Epoch 99/300
6/6 [==============================] - 0s 575us/step - loss: 0.3975 - accuracy: 0.8087
Epoch 100/300
6/6 [==============================] - 0s 563us/step - loss: 0.3971 - accuracy: 0.8116
Epoch 101/300
6/6 [==============================] - 0s 570us/step - loss: 0.3969 - accuracy: 0.8116
Epoch 102/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3966 - accuracy: 0.8116
Epoch 103/300
6/6 [==============================] - 0s 576us/step - loss: 0.3964 - accuracy: 0.8116
Epoch 104/300
6/6 [==============================] - 0s 573us/step - loss: 0.3963 - accuracy: 0.8116
Epoch 105/300
6/6 [==============================] - 0s 566us/step - loss: 0.3959 - accuracy: 0.8116
Epoch 106/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3957 - accuracy: 0.8145
Epoch 107/300
6/6 [==============================] - 0s 569us/step - loss: 0.3951 - accuracy: 0.8145
Epoch 108/300
6/6 [==============================] - 0s 555us/step - loss: 0.3947 - accuracy: 0.8174
Epoch 109/300
6/6 [==============================] - 0s 567us/step - loss: 0.3945 - accuracy: 0.8174
Epoch 110/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3942 - accuracy: 0.8174
Epoch 111/300
6/6 [==============================] - 0s 562us/step - loss: 0.3938 - accuracy: 0.8145
Epoch 112/300
6/6 [==============================] - 0s 560us/step - loss: 0.3935 - accuracy: 0.8145
Epoch 113/300
6/6 [==============================] - 0s 555us/step - loss: 0.3932 - accuracy: 0.8145
Epoch 114/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3929 - accuracy: 0.8145
Epoch 115/300
6/6 [==============================] - 0s 560us/step - loss: 0.3926 - accuracy: 0.8145
Epoch 116/300
6/6 [==============================] - 0s 559us/step - loss: 0.3922 - accuracy: 0.8145
Epoch 117/300
6/6 [==============================] - 0s 558us/step - loss: 0.3920 - accuracy: 0.8145
Epoch 118/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3917 - accuracy: 0.8145
Epoch 119/300
6/6 [==============================] - 0s 554us/step - loss: 0.3915 - accuracy: 0.8203
Epoch 120/300
6/6 [==============================] - 0s 516us/step - loss: 0.3911 - accuracy: 0.8203
Epoch 121/300
6/6 [==============================] - 0s 555us/step - loss: 0.3908 - accuracy: 0.8203
Epoch 122/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3906 - accuracy: 0.8203
Epoch 123/300
6/6 [==============================] - 0s 552us/step - loss: 0.3905 - accuracy: 0.8174
Epoch 124/300
6/6 [==============================] - 0s 556us/step - loss: 0.3901 - accuracy: 0.8203
Epoch 125/300
6/6 [==============================] - 0s 557us/step - loss: 0.3898 - accuracy: 0.8203
Epoch 126/300
6/6 [==============================] - 0s 539us/step - loss: 0.3896 - accuracy: 0.8174
Epoch 127/300
6/6 [==============================] - 0s 531us/step - loss: 0.3893 - accuracy: 0.8203
Epoch 128/300
6/6 [==============================] - 0s 579us/step - loss: 0.3891 - accuracy: 0.8203
Epoch 129/300
6/6 [==============================] - 0s 530us/step - loss: 0.3889 - accuracy: 0.8203
Epoch 130/300
6/6 [==============================] - 0s 542us/step - loss: 0.3885 - accuracy: 0.8203
Epoch 131/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3885 - accuracy: 0.8174
Epoch 132/300
6/6 [==============================] - 0s 538us/step - loss: 0.3881 - accuracy: 0.8174
Epoch 133/300
6/6 [==============================] - 0s 540us/step - loss: 0.3878 - accuracy: 0.8174
Epoch 134/300
6/6 [==============================] - 0s 540us/step - loss: 0.3875 - accuracy: 0.8174
Epoch 135/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3874 - accuracy: 0.8203
Epoch 136/300
6/6 [==============================] - 0s 528us/step - loss: 0.3870 - accuracy: 0.8174
Epoch 137/300
6/6 [==============================] - 0s 541us/step - loss: 0.3868 - accuracy: 0.8174
Epoch 138/300
6/6 [==============================] - 0s 548us/step - loss: 0.3867 - accuracy: 0.8203
Epoch 139/300
6/6 [==============================] - 0s 537us/step - loss: 0.3864 - accuracy: 0.8174
Epoch 140/300
6/6 [==============================] - 0s 551us/step - loss: 0.3860 - accuracy: 0.8174
Epoch 141/300
6/6 [==============================] - 0s 545us/step - loss: 0.3859 - accuracy: 0.8203
Epoch 142/300
6/6 [==============================] - 0s 518us/step - loss: 0.3855 - accuracy: 0.8203
Epoch 143/300
6/6 [==============================] - 0s 536us/step - loss: 0.3853 - accuracy: 0.8203
Epoch 144/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3850 - accuracy: 0.8174
Epoch 145/300
6/6 [==============================] - 0s 566us/step - loss: 0.3847 - accuracy: 0.8174
Epoch 146/300
6/6 [==============================] - 0s 553us/step - loss: 0.3847 - accuracy: 0.8203
Epoch 147/300
6/6 [==============================] - 0s 555us/step - loss: 0.3843 - accuracy: 0.8203
Epoch 148/300
6/6 [==============================] - 0s 556us/step - loss: 0.3841 - accuracy: 0.8203
Epoch 149/300
6/6 [==============================] - 0s 585us/step - loss: 0.3839 - accuracy: 0.8203
Epoch 150/300
6/6 [==============================] - 0s 578us/step - loss: 0.3836 - accuracy: 0.8203
Epoch 151/300
6/6 [==============================] - 0s 541us/step - loss: 0.3835 - accuracy: 0.8232
Epoch 152/300
6/6 [==============================] - 0s 546us/step - loss: 0.3832 - accuracy: 0.8232
Epoch 153/300
6/6 [==============================] - 0s 576us/step - loss: 0.3831 - accuracy: 0.8232
Epoch 154/300
6/6 [==============================] - 0s 638us/step - loss: 0.3829 - accuracy: 0.8232
Epoch 155/300
6/6 [==============================] - 0s 606us/step - loss: 0.3826 - accuracy: 0.8232
Epoch 156/300
6/6 [==============================] - 0s 643us/step - loss: 0.3823 - accuracy: 0.8203
Epoch 157/300
6/6 [==============================] - 0s 621us/step - loss: 0.3820 - accuracy: 0.8174
Epoch 158/300
6/6 [==============================] - 0s 628us/step - loss: 0.3819 - accuracy: 0.8174
Epoch 159/300
6/6 [==============================] - 0s 612us/step - loss: 0.3817 - accuracy: 0.8203
Epoch 160/300
6/6 [==============================] - 0s 621us/step - loss: 0.3815 - accuracy: 0.8203
Epoch 161/300
6/6 [==============================] - 0s 609us/step - loss: 0.3811 - accuracy: 0.8203
Epoch 162/300
6/6 [==============================] - 0s 619us/step - loss: 0.3810 - accuracy: 0.8203
Epoch 163/300
6/6 [==============================] - 0s 673us/step - loss: 0.3809 - accuracy: 0.8203
Epoch 164/300
6/6 [==============================] - 0s 649us/step - loss: 0.3806 - accuracy: 0.8203
Epoch 165/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3804 - accuracy: 0.8203
Epoch 166/300
6/6 [==============================] - 0s 669us/step - loss: 0.3801 - accuracy: 0.8203
Epoch 167/300
6/6 [==============================] - 0s 613us/step - loss: 0.3799 - accuracy: 0.8203
Epoch 168/300
6/6 [==============================] - 0s 642us/step - loss: 0.3797 - accuracy: 0.8203
Epoch 169/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3794 - accuracy: 0.8203
Epoch 170/300
6/6 [==============================] - 0s 636us/step - loss: 0.3792 - accuracy: 0.8203
Epoch 171/300
6/6 [==============================] - 0s 618us/step - loss: 0.3790 - accuracy: 0.8203
Epoch 172/300
6/6 [==============================] - 0s 587us/step - loss: 0.3788 - accuracy: 0.8203
Epoch 173/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3786 - accuracy: 0.8174
Epoch 174/300
6/6 [==============================] - 0s 625us/step - loss: 0.3784 - accuracy: 0.8174
Epoch 175/300
6/6 [==============================] - 0s 580us/step - loss: 0.3783 - accuracy: 0.8174
Epoch 176/300
6/6 [==============================] - 0s 561us/step - loss: 0.3781 - accuracy: 0.8174
Epoch 177/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3778 - accuracy: 0.8174
Epoch 178/300
6/6 [==============================] - 0s 644us/step - loss: 0.3777 - accuracy: 0.8203
Epoch 179/300
6/6 [==============================] - 0s 636us/step - loss: 0.3776 - accuracy: 0.8203
Epoch 180/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3773 - accuracy: 0.8203
Epoch 181/300
6/6 [==============================] - 0s 543us/step - loss: 0.3771 - accuracy: 0.8203
Epoch 182/300
6/6 [==============================] - 0s 573us/step - loss: 0.3771 - accuracy: 0.8174
Epoch 183/300
6/6 [==============================] - 0s 622us/step - loss: 0.3769 - accuracy: 0.8203
Epoch 184/300
6/6 [==============================] - 0s 606us/step - loss: 0.3765 - accuracy: 0.8232
Epoch 185/300
6/6 [==============================] - 0s 647us/step - loss: 0.3765 - accuracy: 0.8203
Epoch 186/300
6/6 [==============================] - 0s 653us/step - loss: 0.3763 - accuracy: 0.8232
Epoch 187/300
6/6 [==============================] - 0s 638us/step - loss: 0.3760 - accuracy: 0.8232
Epoch 188/300
6/6 [==============================] - 0s 630us/step - loss: 0.3760 - accuracy: 0.8232
Epoch 189/300
6/6 [==============================] - 0s 601us/step - loss: 0.3758 - accuracy: 0.8232
Epoch 190/300
6/6 [==============================] - 0s 570us/step - loss: 0.3757 - accuracy: 0.8232
Epoch 191/300
6/6 [==============================] - 0s 576us/step - loss: 0.3755 - accuracy: 0.8232
Epoch 192/300
6/6 [==============================] - 0s 588us/step - loss: 0.3752 - accuracy: 0.8232
Epoch 193/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3749 - accuracy: 0.8232
Epoch 194/300
6/6 [==============================] - 0s 567us/step - loss: 0.3747 - accuracy: 0.8232
Epoch 195/300
6/6 [==============================] - 0s 549us/step - loss: 0.3746 - accuracy: 0.8232
Epoch 196/300
6/6 [==============================] - 0s 575us/step - loss: 0.3745 - accuracy: 0.8232
Epoch 197/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3741 - accuracy: 0.8232
Epoch 198/300
6/6 [==============================] - 0s 543us/step - loss: 0.3739 - accuracy: 0.8232
Epoch 199/300
6/6 [==============================] - 0s 535us/step - loss: 0.3737 - accuracy: 0.8232
Epoch 200/300
6/6 [==============================] - 0s 569us/step - loss: 0.3736 - accuracy: 0.8232
Epoch 201/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3733 - accuracy: 0.8232
Epoch 202/300
6/6 [==============================] - 0s 664us/step - loss: 0.3732 - accuracy: 0.8232
Epoch 203/300
6/6 [==============================] - 0s 576us/step - loss: 0.3731 - accuracy: 0.8232
Epoch 204/300
6/6 [==============================] - 0s 550us/step - loss: 0.3728 - accuracy: 0.8232
Epoch 205/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3728 - accuracy: 0.8203
Epoch 206/300
6/6 [==============================] - 0s 697us/step - loss: 0.3726 - accuracy: 0.8174
Epoch 207/300
6/6 [==============================] - 0s 619us/step - loss: 0.3723 - accuracy: 0.8174
Epoch 208/300
6/6 [==============================] - 0s 572us/step - loss: 0.3722 - accuracy: 0.8174
Epoch 209/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3720 - accuracy: 0.8174
Epoch 210/300
6/6 [==============================] - 0s 598us/step - loss: 0.3718 - accuracy: 0.8174
Epoch 211/300
6/6 [==============================] - 0s 592us/step - loss: 0.3718 - accuracy: 0.8174
Epoch 212/300
6/6 [==============================] - 0s 618us/step - loss: 0.3716 - accuracy: 0.8174
Epoch 213/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3712 - accuracy: 0.8203
Epoch 214/300
6/6 [==============================] - 0s 636us/step - loss: 0.3712 - accuracy: 0.8232
Epoch 215/300
6/6 [==============================] - 0s 622us/step - loss: 0.3709 - accuracy: 0.8232
Epoch 216/300
6/6 [==============================] - 0s 636us/step - loss: 0.3706 - accuracy: 0.8232
Epoch 217/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3703 - accuracy: 0.8174
Epoch 218/300
6/6 [==============================] - 0s 640us/step - loss: 0.3701 - accuracy: 0.8174
Epoch 219/300
6/6 [==============================] - 0s 619us/step - loss: 0.3700 - accuracy: 0.8174
Epoch 220/300
6/6 [==============================] - 0s 629us/step - loss: 0.3698 - accuracy: 0.8174
Epoch 221/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3695 - accuracy: 0.8174
Epoch 222/300
6/6 [==============================] - 0s 631us/step - loss: 0.3693 - accuracy: 0.8203
Epoch 223/300
6/6 [==============================] - 0s 626us/step - loss: 0.3691 - accuracy: 0.8203
Epoch 224/300
6/6 [==============================] - 0s 626us/step - loss: 0.3690 - accuracy: 0.8203
Epoch 225/300
6/6 [==============================] - 0s 618us/step - loss: 0.3689 - accuracy: 0.8203
Epoch 226/300
6/6 [==============================] - 0s 568us/step - loss: 0.3685 - accuracy: 0.8174
Epoch 227/300
6/6 [==============================] - 0s 560us/step - loss: 0.3685 - accuracy: 0.8174
Epoch 228/300
6/6 [==============================] - 0s 555us/step - loss: 0.3681 - accuracy: 0.8174
Epoch 229/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3679 - accuracy: 0.8232
Epoch 230/300
6/6 [==============================] - 0s 583us/step - loss: 0.3679 - accuracy: 0.8232
Epoch 231/300
6/6 [==============================] - 0s 561us/step - loss: 0.3678 - accuracy: 0.8232
Epoch 232/300
6/6 [==============================] - 0s 602us/step - loss: 0.3675 - accuracy: 0.8232
Epoch 233/300
6/6 [==============================] - 0s 749us/step - loss: 0.3672 - accuracy: 0.8203
Epoch 234/300
6/6 [==============================] - 0s 649us/step - loss: 0.3670 - accuracy: 0.8203
Epoch 235/300
6/6 [==============================] - 0s 674us/step - loss: 0.3668 - accuracy: 0.8145
Epoch 236/300
6/6 [==============================] - 0s 670us/step - loss: 0.3667 - accuracy: 0.8145
Epoch 237/300
6/6 [==============================] - 0s 706us/step - loss: 0.3664 - accuracy: 0.8145
Epoch 238/300
6/6 [==============================] - 0s 639us/step - loss: 0.3662 - accuracy: 0.8174
Epoch 239/300
6/6 [==============================] - 0s 640us/step - loss: 0.3663 - accuracy: 0.8174
Epoch 240/300
6/6 [==============================] - 0s 619us/step - loss: 0.3660 - accuracy: 0.8145
Epoch 241/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3659 - accuracy: 0.8174
Epoch 242/300
6/6 [==============================] - 0s 597us/step - loss: 0.3656 - accuracy: 0.8203
Epoch 243/300
6/6 [==============================] - 0s 625us/step - loss: 0.3653 - accuracy: 0.8203
Epoch 244/300
6/6 [==============================] - 0s 619us/step - loss: 0.3651 - accuracy: 0.8203
Epoch 245/300
6/6 [==============================] - 0s 698us/step - loss: 0.3650 - accuracy: 0.8145
Epoch 246/300
6/6 [==============================] - 0s 608us/step - loss: 0.3646 - accuracy: 0.8145
Epoch 247/300
6/6 [==============================] - 0s 554us/step - loss: 0.3644 - accuracy: 0.8145
Epoch 248/300
6/6 [==============================] - 0s 568us/step - loss: 0.3643 - accuracy: 0.8145
Epoch 249/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3640 - accuracy: 0.8116
Epoch 250/300
6/6 [==============================] - 0s 749us/step - loss: 0.3637 - accuracy: 0.8145
Epoch 251/300
6/6 [==============================] - 0s 668us/step - loss: 0.3636 - accuracy: 0.8145
Epoch 252/300
6/6 [==============================] - 0s 617us/step - loss: 0.3634 - accuracy: 0.8145
Epoch 253/300
6/6 [==============================] - 0s 623us/step - loss: 0.3634 - accuracy: 0.8145
Epoch 254/300
6/6 [==============================] - 0s 634us/step - loss: 0.3628 - accuracy: 0.8145
Epoch 255/300
6/6 [==============================] - 0s 617us/step - loss: 0.3627 - accuracy: 0.8145
Epoch 256/300
6/6 [==============================] - 0s 607us/step - loss: 0.3626 - accuracy: 0.8145
Epoch 257/300
6/6 [==============================] - 0s 631us/step - loss: 0.3624 - accuracy: 0.8145
Epoch 258/300
6/6 [==============================] - 0s 692us/step - loss: 0.3622 - accuracy: 0.8174
Epoch 259/300
6/6 [==============================] - 0s 695us/step - loss: 0.3621 - accuracy: 0.8174
Epoch 260/300
6/6 [==============================] - 0s 574us/step - loss: 0.3618 - accuracy: 0.8174
Epoch 261/300
6/6 [==============================] - 0s 564us/step - loss: 0.3616 - accuracy: 0.8174
Epoch 262/300
6/6 [==============================] - 0s 551us/step - loss: 0.3614 - accuracy: 0.8174
Epoch 263/300
6/6 [==============================] - 0s 555us/step - loss: 0.3612 - accuracy: 0.8174
Epoch 264/300
6/6 [==============================] - 0s 582us/step - loss: 0.3611 - accuracy: 0.8145
Epoch 265/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3613 - accuracy: 0.8145
Epoch 266/300
6/6 [==============================] - 0s 588us/step - loss: 0.3606 - accuracy: 0.8174
Epoch 267/300
6/6 [==============================] - 0s 563us/step - loss: 0.3605 - accuracy: 0.8174
Epoch 268/300
6/6 [==============================] - 0s 565us/step - loss: 0.3603 - accuracy: 0.8203
Epoch 269/300
6/6 [==============================] - 0s 615us/step - loss: 0.3603 - accuracy: 0.8174
Epoch 270/300
6/6 [==============================] - 0s 555us/step - loss: 0.3601 - accuracy: 0.8174
Epoch 271/300
6/6 [==============================] - 0s 572us/step - loss: 0.3598 - accuracy: 0.8174
Epoch 272/300
6/6 [==============================] - 0s 537us/step - loss: 0.3598 - accuracy: 0.8203
Epoch 273/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3595 - accuracy: 0.8174
Epoch 274/300
6/6 [==============================] - 0s 536us/step - loss: 0.3593 - accuracy: 0.8174
Epoch 275/300
6/6 [==============================] - 0s 572us/step - loss: 0.3592 - accuracy: 0.8174
Epoch 276/300
6/6 [==============================] - 0s 566us/step - loss: 0.3590 - accuracy: 0.8203
Epoch 277/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3589 - accuracy: 0.8174
Epoch 278/300
6/6 [==============================] - 0s 557us/step - loss: 0.3589 - accuracy: 0.8174
Epoch 279/300
6/6 [==============================] - 0s 569us/step - loss: 0.3586 - accuracy: 0.8174
Epoch 280/300
6/6 [==============================] - 0s 572us/step - loss: 0.3584 - accuracy: 0.8174
Epoch 281/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3583 - accuracy: 0.8174
Epoch 282/300
6/6 [==============================] - 0s 566us/step - loss: 0.3583 - accuracy: 0.8174
Epoch 283/300
6/6 [==============================] - 0s 589us/step - loss: 0.3580 - accuracy: 0.8174
Epoch 284/300
6/6 [==============================] - 0s 567us/step - loss: 0.3580 - accuracy: 0.8174
Epoch 285/300
6/6 [==============================] - 0s 567us/step - loss: 0.3577 - accuracy: 0.8174
Epoch 286/300
6/6 [==============================] - 0s 563us/step - loss: 0.3575 - accuracy: 0.8174
Epoch 287/300
6/6 [==============================] - 0s 614us/step - loss: 0.3574 - accuracy: 0.8203
Epoch 288/300
6/6 [==============================] - 0s 589us/step - loss: 0.3572 - accuracy: 0.8174
Epoch 289/300
6/6 [==============================] - 0s 561us/step - loss: 0.3571 - accuracy: 0.8203
Epoch 290/300
6/6 [==============================] - 0s 576us/step - loss: 0.3568 - accuracy: 0.8203
Epoch 291/300
6/6 [==============================] - 0s 559us/step - loss: 0.3566 - accuracy: 0.8203
Epoch 292/300
6/6 [==============================] - 0s 553us/step - loss: 0.3565 - accuracy: 0.8203
Epoch 293/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3563 - accuracy: 0.8203
Epoch 294/300
6/6 [==============================] - 0s 552us/step - loss: 0.3561 - accuracy: 0.8203
Epoch 295/300
6/6 [==============================] - 0s 553us/step - loss: 0.3560 - accuracy: 0.8203
Epoch 296/300
6/6 [==============================] - 0s 543us/step - loss: 0.3558 - accuracy: 0.8203
Epoch 297/300
6/6 [==============================] - 0s 579us/step - loss: 0.3556 - accuracy: 0.8203
Epoch 298/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3554 - accuracy: 0.8232
Epoch 299/300
6/6 [==============================] - 0s 557us/step - loss: 0.3554 - accuracy: 0.8203
Epoch 300/300
6/6 [==============================] - 0s 710us/step - loss: 0.3551 - accuracy: 0.8232
Epoch 1/300
6/6 [==============================] - 0s 715us/step - loss: 0.6609 - accuracy: 0.6638
Epoch 2/300
6/6 [==============================] - 0s 591us/step - loss: 0.6484 - accuracy: 0.6638
Epoch 3/300
6/6 [==============================] - 0s 13ms/step - loss: 0.6371 - accuracy: 0.6841
Epoch 4/300
6/6 [==============================] - 0s 614us/step - loss: 0.6259 - accuracy: 0.6899
Epoch 5/300
6/6 [==============================] - 0s 628us/step - loss: 0.6151 - accuracy: 0.6928
Epoch 6/300
6/6 [==============================] - 0s 614us/step - loss: 0.6054 - accuracy: 0.6957
Epoch 7/300
6/6 [==============================] - 0s 627us/step - loss: 0.5966 - accuracy: 0.7072
Epoch 8/300
6/6 [==============================] - 0s 634us/step - loss: 0.5871 - accuracy: 0.7130
Epoch 9/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5789 - accuracy: 0.7217
Epoch 10/300
6/6 [==============================] - 0s 645us/step - loss: 0.5706 - accuracy: 0.7217
Epoch 11/300
6/6 [==============================] - 0s 612us/step - loss: 0.5633 - accuracy: 0.7159
Epoch 12/300
6/6 [==============================] - 0s 618us/step - loss: 0.5561 - accuracy: 0.7159
Epoch 13/300
6/6 [==============================] - 0s 654us/step - loss: 0.5493 - accuracy: 0.7188
Epoch 14/300
6/6 [==============================] - 0s 657us/step - loss: 0.5426 - accuracy: 0.7333
Epoch 15/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5365 - accuracy: 0.7420
Epoch 16/300
6/6 [==============================] - 0s 646us/step - loss: 0.5307 - accuracy: 0.7507
Epoch 17/300
6/6 [==============================] - 0s 575us/step - loss: 0.5255 - accuracy: 0.7507
Epoch 18/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5199 - accuracy: 0.7565
Epoch 19/300
6/6 [==============================] - 0s 567us/step - loss: 0.5146 - accuracy: 0.7594
Epoch 20/300
6/6 [==============================] - 0s 580us/step - loss: 0.5096 - accuracy: 0.7623
Epoch 21/300
6/6 [==============================] - 0s 603us/step - loss: 0.5047 - accuracy: 0.7623
Epoch 22/300
6/6 [==============================] - 0s 589us/step - loss: 0.4999 - accuracy: 0.7652
Epoch 23/300
6/6 [==============================] - 0s 572us/step - loss: 0.4960 - accuracy: 0.7681
Epoch 24/300
6/6 [==============================] - 0s 584us/step - loss: 0.4917 - accuracy: 0.7710
Epoch 25/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4877 - accuracy: 0.7768
Epoch 26/300
6/6 [==============================] - 0s 579us/step - loss: 0.4843 - accuracy: 0.7826
Epoch 27/300
6/6 [==============================] - 0s 592us/step - loss: 0.4807 - accuracy: 0.7884
Epoch 28/300
6/6 [==============================] - 0s 543us/step - loss: 0.4774 - accuracy: 0.7855
Epoch 29/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4747 - accuracy: 0.7855
Epoch 30/300
6/6 [==============================] - 0s 566us/step - loss: 0.4718 - accuracy: 0.7826
Epoch 31/300
6/6 [==============================] - 0s 547us/step - loss: 0.4692 - accuracy: 0.7855
Epoch 32/300
6/6 [==============================] - 0s 599us/step - loss: 0.4665 - accuracy: 0.7884
Epoch 33/300
6/6 [==============================] - 0s 585us/step - loss: 0.4640 - accuracy: 0.7884
Epoch 34/300
6/6 [==============================] - 0s 577us/step - loss: 0.4621 - accuracy: 0.7913
Epoch 35/300
6/6 [==============================] - 0s 586us/step - loss: 0.4600 - accuracy: 0.7884
Epoch 36/300
6/6 [==============================] - 0s 582us/step - loss: 0.4576 - accuracy: 0.7913
Epoch 37/300
6/6 [==============================] - 0s 607us/step - loss: 0.4556 - accuracy: 0.7913
Epoch 38/300
6/6 [==============================] - 0s 581us/step - loss: 0.4536 - accuracy: 0.7942
Epoch 39/300
6/6 [==============================] - 0s 588us/step - loss: 0.4514 - accuracy: 0.7913
Epoch 40/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4493 - accuracy: 0.7971
Epoch 41/300
6/6 [==============================] - 0s 618us/step - loss: 0.4477 - accuracy: 0.8029
Epoch 42/300
6/6 [==============================] - 0s 578us/step - loss: 0.4456 - accuracy: 0.8029
Epoch 43/300
6/6 [==============================] - 0s 569us/step - loss: 0.4441 - accuracy: 0.8029
Epoch 44/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4424 - accuracy: 0.8058
Epoch 45/300
6/6 [==============================] - 0s 579us/step - loss: 0.4407 - accuracy: 0.8087
Epoch 46/300
6/6 [==============================] - 0s 569us/step - loss: 0.4392 - accuracy: 0.8087
Epoch 47/300
6/6 [==============================] - 0s 583us/step - loss: 0.4376 - accuracy: 0.8087
Epoch 48/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4362 - accuracy: 0.8029
Epoch 49/300
6/6 [==============================] - 0s 571us/step - loss: 0.4350 - accuracy: 0.8029
Epoch 50/300
6/6 [==============================] - 0s 604us/step - loss: 0.4337 - accuracy: 0.8029
Epoch 51/300
6/6 [==============================] - 0s 575us/step - loss: 0.4324 - accuracy: 0.8000
Epoch 52/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4312 - accuracy: 0.8000
Epoch 53/300
6/6 [==============================] - 0s 584us/step - loss: 0.4300 - accuracy: 0.8000
Epoch 54/300
6/6 [==============================] - 0s 576us/step - loss: 0.4290 - accuracy: 0.8000
Epoch 55/300
6/6 [==============================] - 0s 566us/step - loss: 0.4276 - accuracy: 0.8029
Epoch 56/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4266 - accuracy: 0.7971
Epoch 57/300
6/6 [==============================] - 0s 563us/step - loss: 0.4255 - accuracy: 0.8029
Epoch 58/300
6/6 [==============================] - 0s 568us/step - loss: 0.4244 - accuracy: 0.8029
Epoch 59/300
6/6 [==============================] - 0s 550us/step - loss: 0.4235 - accuracy: 0.8029
Epoch 60/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4226 - accuracy: 0.8058
Epoch 61/300
6/6 [==============================] - 0s 611us/step - loss: 0.4215 - accuracy: 0.8058
Epoch 62/300
6/6 [==============================] - 0s 559us/step - loss: 0.4207 - accuracy: 0.8029
Epoch 63/300
6/6 [==============================] - 0s 538us/step - loss: 0.4200 - accuracy: 0.8029
Epoch 64/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4189 - accuracy: 0.8029
Epoch 65/300
6/6 [==============================] - 0s 595us/step - loss: 0.4180 - accuracy: 0.8116
Epoch 66/300
6/6 [==============================] - 0s 555us/step - loss: 0.4171 - accuracy: 0.8116
Epoch 67/300
6/6 [==============================] - 0s 552us/step - loss: 0.4163 - accuracy: 0.8116
Epoch 68/300
6/6 [==============================] - 0s 545us/step - loss: 0.4153 - accuracy: 0.8116
Epoch 69/300
6/6 [==============================] - 0s 555us/step - loss: 0.4146 - accuracy: 0.8116
Epoch 70/300
6/6 [==============================] - 0s 541us/step - loss: 0.4137 - accuracy: 0.8116
Epoch 71/300
6/6 [==============================] - 0s 550us/step - loss: 0.4129 - accuracy: 0.8116
Epoch 72/300
6/6 [==============================] - 0s 537us/step - loss: 0.4120 - accuracy: 0.8116
Epoch 73/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4113 - accuracy: 0.8145
Epoch 74/300
6/6 [==============================] - 0s 559us/step - loss: 0.4103 - accuracy: 0.8145
Epoch 75/300
6/6 [==============================] - 0s 564us/step - loss: 0.4096 - accuracy: 0.8145
Epoch 76/300
6/6 [==============================] - 0s 547us/step - loss: 0.4088 - accuracy: 0.8116
Epoch 77/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4081 - accuracy: 0.8116
Epoch 78/300
6/6 [==============================] - 0s 563us/step - loss: 0.4072 - accuracy: 0.8116
Epoch 79/300
6/6 [==============================] - 0s 552us/step - loss: 0.4065 - accuracy: 0.8116
Epoch 80/300
6/6 [==============================] - 0s 599us/step - loss: 0.4056 - accuracy: 0.8145
Epoch 81/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4050 - accuracy: 0.8145
Epoch 82/300
6/6 [==============================] - 0s 560us/step - loss: 0.4041 - accuracy: 0.8203
Epoch 83/300
6/6 [==============================] - 0s 589us/step - loss: 0.4036 - accuracy: 0.8174
Epoch 84/300
6/6 [==============================] - 0s 565us/step - loss: 0.4028 - accuracy: 0.8174
Epoch 85/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4019 - accuracy: 0.8203
Epoch 86/300
6/6 [==============================] - 0s 589us/step - loss: 0.4010 - accuracy: 0.8203
Epoch 87/300
6/6 [==============================] - 0s 578us/step - loss: 0.4001 - accuracy: 0.8203
Epoch 88/300
6/6 [==============================] - 0s 556us/step - loss: 0.3995 - accuracy: 0.8203
Epoch 89/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3988 - accuracy: 0.8203
Epoch 90/300
6/6 [==============================] - 0s 584us/step - loss: 0.3983 - accuracy: 0.8203
Epoch 91/300
6/6 [==============================] - 0s 559us/step - loss: 0.3973 - accuracy: 0.8261
Epoch 92/300
6/6 [==============================] - 0s 573us/step - loss: 0.3967 - accuracy: 0.8261
Epoch 93/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3960 - accuracy: 0.8261
Epoch 94/300
6/6 [==============================] - 0s 558us/step - loss: 0.3954 - accuracy: 0.8261
Epoch 95/300
6/6 [==============================] - 0s 562us/step - loss: 0.3947 - accuracy: 0.8290
Epoch 96/300
6/6 [==============================] - 0s 585us/step - loss: 0.3941 - accuracy: 0.8290
Epoch 97/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3934 - accuracy: 0.8290
Epoch 98/300
6/6 [==============================] - 0s 582us/step - loss: 0.3928 - accuracy: 0.8290
Epoch 99/300
6/6 [==============================] - 0s 566us/step - loss: 0.3922 - accuracy: 0.8290
Epoch 100/300
6/6 [==============================] - 0s 563us/step - loss: 0.3917 - accuracy: 0.8290
Epoch 101/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3911 - accuracy: 0.8290
Epoch 102/300
6/6 [==============================] - 0s 586us/step - loss: 0.3904 - accuracy: 0.8290
Epoch 103/300
6/6 [==============================] - 0s 553us/step - loss: 0.3900 - accuracy: 0.8290
Epoch 104/300
6/6 [==============================] - 0s 582us/step - loss: 0.3893 - accuracy: 0.8290
Epoch 105/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3887 - accuracy: 0.8290
Epoch 106/300
6/6 [==============================] - 0s 582us/step - loss: 0.3882 - accuracy: 0.8290
Epoch 107/300
6/6 [==============================] - 0s 564us/step - loss: 0.3879 - accuracy: 0.8290
Epoch 108/300
6/6 [==============================] - 0s 562us/step - loss: 0.3872 - accuracy: 0.8290
Epoch 109/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3868 - accuracy: 0.8290
Epoch 110/300
6/6 [==============================] - 0s 555us/step - loss: 0.3866 - accuracy: 0.8290
Epoch 111/300
6/6 [==============================] - 0s 609us/step - loss: 0.3858 - accuracy: 0.8290
Epoch 112/300
6/6 [==============================] - 0s 567us/step - loss: 0.3855 - accuracy: 0.8290
Epoch 113/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3848 - accuracy: 0.8290
Epoch 114/300
6/6 [==============================] - 0s 556us/step - loss: 0.3843 - accuracy: 0.8290
Epoch 115/300
6/6 [==============================] - 0s 624us/step - loss: 0.3838 - accuracy: 0.8290
Epoch 116/300
6/6 [==============================] - 0s 553us/step - loss: 0.3832 - accuracy: 0.8261
Epoch 117/300
6/6 [==============================] - 0s 573us/step - loss: 0.3827 - accuracy: 0.8261
Epoch 118/300
6/6 [==============================] - 0s 590us/step - loss: 0.3820 - accuracy: 0.8261
Epoch 119/300
6/6 [==============================] - 0s 593us/step - loss: 0.3815 - accuracy: 0.8261
Epoch 120/300
6/6 [==============================] - 0s 586us/step - loss: 0.3809 - accuracy: 0.8261
Epoch 121/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3806 - accuracy: 0.8261
Epoch 122/300
6/6 [==============================] - 0s 584us/step - loss: 0.3801 - accuracy: 0.8261
Epoch 123/300
6/6 [==============================] - 0s 606us/step - loss: 0.3795 - accuracy: 0.8261
Epoch 124/300
6/6 [==============================] - 0s 579us/step - loss: 0.3790 - accuracy: 0.8261
Epoch 125/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3785 - accuracy: 0.8261
Epoch 126/300
6/6 [==============================] - 0s 569us/step - loss: 0.3782 - accuracy: 0.8261
Epoch 127/300
6/6 [==============================] - 0s 583us/step - loss: 0.3777 - accuracy: 0.8261
Epoch 128/300
6/6 [==============================] - 0s 561us/step - loss: 0.3770 - accuracy: 0.8261
Epoch 129/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3767 - accuracy: 0.8261
Epoch 130/300
6/6 [==============================] - 0s 576us/step - loss: 0.3762 - accuracy: 0.8261
Epoch 131/300
6/6 [==============================] - 0s 598us/step - loss: 0.3756 - accuracy: 0.8261
Epoch 132/300
6/6 [==============================] - 0s 555us/step - loss: 0.3751 - accuracy: 0.8261
Epoch 133/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3746 - accuracy: 0.8290
Epoch 134/300
6/6 [==============================] - 0s 558us/step - loss: 0.3740 - accuracy: 0.8290
Epoch 135/300
6/6 [==============================] - 0s 560us/step - loss: 0.3736 - accuracy: 0.8290
Epoch 136/300
6/6 [==============================] - 0s 579us/step - loss: 0.3732 - accuracy: 0.8290
Epoch 137/300
6/6 [==============================] - 0s 606us/step - loss: 0.3726 - accuracy: 0.8290
Epoch 138/300
6/6 [==============================] - 0s 553us/step - loss: 0.3720 - accuracy: 0.8261
Epoch 139/300
6/6 [==============================] - 0s 573us/step - loss: 0.3716 - accuracy: 0.8261
Epoch 140/300
6/6 [==============================] - 0s 565us/step - loss: 0.3712 - accuracy: 0.8261
Epoch 141/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3706 - accuracy: 0.8261
Epoch 142/300
6/6 [==============================] - 0s 587us/step - loss: 0.3702 - accuracy: 0.8232
Epoch 143/300
6/6 [==============================] - 0s 546us/step - loss: 0.3696 - accuracy: 0.8261
Epoch 144/300
6/6 [==============================] - 0s 576us/step - loss: 0.3691 - accuracy: 0.8261
Epoch 145/300
6/6 [==============================] - 0s 559us/step - loss: 0.3688 - accuracy: 0.8290
Epoch 146/300
6/6 [==============================] - 0s 590us/step - loss: 0.3684 - accuracy: 0.8290
Epoch 147/300
6/6 [==============================] - 0s 557us/step - loss: 0.3679 - accuracy: 0.8290
Epoch 148/300
6/6 [==============================] - 0s 539us/step - loss: 0.3674 - accuracy: 0.8261
Epoch 149/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3669 - accuracy: 0.8290
Epoch 150/300
6/6 [==============================] - 0s 581us/step - loss: 0.3665 - accuracy: 0.8290
Epoch 151/300
6/6 [==============================] - 0s 591us/step - loss: 0.3662 - accuracy: 0.8261
Epoch 152/300
6/6 [==============================] - 0s 557us/step - loss: 0.3658 - accuracy: 0.8261
Epoch 153/300
6/6 [==============================] - 0s 685us/step - loss: 0.3655 - accuracy: 0.8261
Epoch 154/300
6/6 [==============================] - 0s 584us/step - loss: 0.3650 - accuracy: 0.8232
Epoch 155/300
6/6 [==============================] - 0s 554us/step - loss: 0.3645 - accuracy: 0.8232
Epoch 156/300
6/6 [==============================] - 0s 565us/step - loss: 0.3642 - accuracy: 0.8232
Epoch 157/300
6/6 [==============================] - 0s 585us/step - loss: 0.3636 - accuracy: 0.8232
Epoch 158/300
6/6 [==============================] - 0s 560us/step - loss: 0.3632 - accuracy: 0.8232
Epoch 159/300
6/6 [==============================] - 0s 556us/step - loss: 0.3628 - accuracy: 0.8232
Epoch 160/300
6/6 [==============================] - 0s 553us/step - loss: 0.3623 - accuracy: 0.8232
Epoch 161/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3619 - accuracy: 0.8232
Epoch 162/300
6/6 [==============================] - 0s 584us/step - loss: 0.3616 - accuracy: 0.8232
Epoch 163/300
6/6 [==============================] - 0s 541us/step - loss: 0.3613 - accuracy: 0.8232
Epoch 164/300
6/6 [==============================] - 0s 552us/step - loss: 0.3609 - accuracy: 0.8203
Epoch 165/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3606 - accuracy: 0.8232
Epoch 166/300
6/6 [==============================] - 0s 568us/step - loss: 0.3604 - accuracy: 0.8232
Epoch 167/300
6/6 [==============================] - 0s 582us/step - loss: 0.3601 - accuracy: 0.8261
Epoch 168/300
6/6 [==============================] - 0s 560us/step - loss: 0.3596 - accuracy: 0.8232
Epoch 169/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3593 - accuracy: 0.8232
Epoch 170/300
6/6 [==============================] - 0s 577us/step - loss: 0.3589 - accuracy: 0.8232
Epoch 171/300
6/6 [==============================] - 0s 593us/step - loss: 0.3586 - accuracy: 0.8203
Epoch 172/300
6/6 [==============================] - 0s 534us/step - loss: 0.3582 - accuracy: 0.8174
Epoch 173/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3579 - accuracy: 0.8174
Epoch 174/300
6/6 [==============================] - 0s 568us/step - loss: 0.3577 - accuracy: 0.8203
Epoch 175/300
6/6 [==============================] - 0s 558us/step - loss: 0.3573 - accuracy: 0.8203
Epoch 176/300
6/6 [==============================] - 0s 528us/step - loss: 0.3570 - accuracy: 0.8203
Epoch 177/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3567 - accuracy: 0.8261
Epoch 178/300
6/6 [==============================] - 0s 535us/step - loss: 0.3563 - accuracy: 0.8261
Epoch 179/300
6/6 [==============================] - 0s 552us/step - loss: 0.3561 - accuracy: 0.8261
Epoch 180/300
6/6 [==============================] - 0s 611us/step - loss: 0.3559 - accuracy: 0.8261
Epoch 181/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3556 - accuracy: 0.8261
Epoch 182/300
6/6 [==============================] - 0s 656us/step - loss: 0.3553 - accuracy: 0.8290
Epoch 183/300
6/6 [==============================] - 0s 668us/step - loss: 0.3550 - accuracy: 0.8261
Epoch 184/300
6/6 [==============================] - 0s 580us/step - loss: 0.3547 - accuracy: 0.8232
Epoch 185/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3543 - accuracy: 0.8232
Epoch 186/300
6/6 [==============================] - 0s 654us/step - loss: 0.3545 - accuracy: 0.8232
Epoch 187/300
6/6 [==============================] - 0s 671us/step - loss: 0.3542 - accuracy: 0.8232
Epoch 188/300
6/6 [==============================] - 0s 615us/step - loss: 0.3537 - accuracy: 0.8232
Epoch 189/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3533 - accuracy: 0.8290
Epoch 190/300
6/6 [==============================] - 0s 648us/step - loss: 0.3531 - accuracy: 0.8261
Epoch 191/300
6/6 [==============================] - 0s 651us/step - loss: 0.3529 - accuracy: 0.8232
Epoch 192/300
6/6 [==============================] - 0s 576us/step - loss: 0.3526 - accuracy: 0.8232
Epoch 193/300
6/6 [==============================] - 0s 589us/step - loss: 0.3522 - accuracy: 0.8203
Epoch 194/300
6/6 [==============================] - 0s 556us/step - loss: 0.3523 - accuracy: 0.8203
Epoch 195/300
6/6 [==============================] - 0s 577us/step - loss: 0.3519 - accuracy: 0.8290
Epoch 196/300
6/6 [==============================] - 0s 554us/step - loss: 0.3516 - accuracy: 0.8261
Epoch 197/300
6/6 [==============================] - 0s 574us/step - loss: 0.3513 - accuracy: 0.8261
Epoch 198/300
6/6 [==============================] - 0s 588us/step - loss: 0.3512 - accuracy: 0.8203
Epoch 199/300
6/6 [==============================] - 0s 576us/step - loss: 0.3508 - accuracy: 0.8232
Epoch 200/300
6/6 [==============================] - 0s 550us/step - loss: 0.3506 - accuracy: 0.8232
Epoch 201/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3504 - accuracy: 0.8232
Epoch 202/300
6/6 [==============================] - 0s 582us/step - loss: 0.3502 - accuracy: 0.8261
Epoch 203/300
6/6 [==============================] - 0s 535us/step - loss: 0.3497 - accuracy: 0.8261
Epoch 204/300
6/6 [==============================] - 0s 573us/step - loss: 0.3496 - accuracy: 0.8261
Epoch 205/300
6/6 [==============================] - 0s 608us/step - loss: 0.3493 - accuracy: 0.8261
Epoch 206/300
6/6 [==============================] - 0s 558us/step - loss: 0.3491 - accuracy: 0.8261
Epoch 207/300
6/6 [==============================] - 0s 554us/step - loss: 0.3489 - accuracy: 0.8261
Epoch 208/300
6/6 [==============================] - 0s 576us/step - loss: 0.3486 - accuracy: 0.8290
Epoch 209/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3484 - accuracy: 0.8261
Epoch 210/300
6/6 [==============================] - 0s 551us/step - loss: 0.3480 - accuracy: 0.8261
Epoch 211/300
6/6 [==============================] - 0s 562us/step - loss: 0.3477 - accuracy: 0.8261
Epoch 212/300
6/6 [==============================] - 0s 537us/step - loss: 0.3475 - accuracy: 0.8261
Epoch 213/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3475 - accuracy: 0.8290
Epoch 214/300
6/6 [==============================] - 0s 577us/step - loss: 0.3471 - accuracy: 0.8319
Epoch 215/300
6/6 [==============================] - 0s 558us/step - loss: 0.3468 - accuracy: 0.8319
Epoch 216/300
6/6 [==============================] - 0s 545us/step - loss: 0.3466 - accuracy: 0.8290
Epoch 217/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3462 - accuracy: 0.8290
Epoch 218/300
6/6 [==============================] - 0s 593us/step - loss: 0.3461 - accuracy: 0.8319
Epoch 219/300
6/6 [==============================] - 0s 576us/step - loss: 0.3458 - accuracy: 0.8348
Epoch 220/300
6/6 [==============================] - 0s 583us/step - loss: 0.3456 - accuracy: 0.8377
Epoch 221/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3454 - accuracy: 0.8377
Epoch 222/300
6/6 [==============================] - 0s 559us/step - loss: 0.3452 - accuracy: 0.8348
Epoch 223/300
6/6 [==============================] - 0s 551us/step - loss: 0.3451 - accuracy: 0.8377
Epoch 224/300
6/6 [==============================] - 0s 548us/step - loss: 0.3447 - accuracy: 0.8377
Epoch 225/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3445 - accuracy: 0.8377
Epoch 226/300
6/6 [==============================] - 0s 579us/step - loss: 0.3442 - accuracy: 0.8377
Epoch 227/300
6/6 [==============================] - 0s 601us/step - loss: 0.3442 - accuracy: 0.8377
Epoch 228/300
6/6 [==============================] - 0s 572us/step - loss: 0.3438 - accuracy: 0.8377
Epoch 229/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3436 - accuracy: 0.8348
Epoch 230/300
6/6 [==============================] - 0s 576us/step - loss: 0.3436 - accuracy: 0.8348
Epoch 231/300
6/6 [==============================] - 0s 587us/step - loss: 0.3434 - accuracy: 0.8348
Epoch 232/300
6/6 [==============================] - 0s 562us/step - loss: 0.3433 - accuracy: 0.8406
Epoch 233/300
6/6 [==============================] - 0s 563us/step - loss: 0.3430 - accuracy: 0.8406
Epoch 234/300
6/6 [==============================] - 0s 593us/step - loss: 0.3430 - accuracy: 0.8406
Epoch 235/300
6/6 [==============================] - 0s 580us/step - loss: 0.3428 - accuracy: 0.8406
Epoch 236/300
6/6 [==============================] - 0s 585us/step - loss: 0.3425 - accuracy: 0.8406
Epoch 237/300
6/6 [==============================] - 0s 562us/step - loss: 0.3422 - accuracy: 0.8406
Epoch 238/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3419 - accuracy: 0.8377
Epoch 239/300
6/6 [==============================] - 0s 571us/step - loss: 0.3419 - accuracy: 0.8377
Epoch 240/300
6/6 [==============================] - 0s 556us/step - loss: 0.3415 - accuracy: 0.8377
Epoch 241/300
6/6 [==============================] - 0s 550us/step - loss: 0.3413 - accuracy: 0.8377
Epoch 242/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3410 - accuracy: 0.8377
Epoch 243/300
6/6 [==============================] - 0s 563us/step - loss: 0.3410 - accuracy: 0.8406
Epoch 244/300
6/6 [==============================] - 0s 569us/step - loss: 0.3407 - accuracy: 0.8406
Epoch 245/300
6/6 [==============================] - 0s 560us/step - loss: 0.3404 - accuracy: 0.8406
Epoch 246/300
6/6 [==============================] - 0s 581us/step - loss: 0.3402 - accuracy: 0.8377
Epoch 247/300
6/6 [==============================] - 0s 547us/step - loss: 0.3399 - accuracy: 0.8406
Epoch 248/300
6/6 [==============================] - 0s 554us/step - loss: 0.3397 - accuracy: 0.8406
Epoch 249/300
6/6 [==============================] - 0s 571us/step - loss: 0.3399 - accuracy: 0.8406
Epoch 250/300
6/6 [==============================] - 0s 550us/step - loss: 0.3394 - accuracy: 0.8406
Epoch 251/300
6/6 [==============================] - 0s 571us/step - loss: 0.3393 - accuracy: 0.8406
Epoch 252/300
6/6 [==============================] - 0s 577us/step - loss: 0.3390 - accuracy: 0.8406
Epoch 253/300
6/6 [==============================] - 0s 606us/step - loss: 0.3387 - accuracy: 0.8406
Epoch 254/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3386 - accuracy: 0.8406
Epoch 255/300
6/6 [==============================] - 0s 588us/step - loss: 0.3385 - accuracy: 0.8406
Epoch 256/300
6/6 [==============================] - 0s 629us/step - loss: 0.3383 - accuracy: 0.8406
Epoch 257/300
6/6 [==============================] - 0s 581us/step - loss: 0.3381 - accuracy: 0.8348
Epoch 258/300
6/6 [==============================] - 0s 547us/step - loss: 0.3378 - accuracy: 0.8377
Epoch 259/300
6/6 [==============================] - 0s 575us/step - loss: 0.3376 - accuracy: 0.8348
Epoch 260/300
6/6 [==============================] - 0s 560us/step - loss: 0.3375 - accuracy: 0.8377
Epoch 261/300
6/6 [==============================] - 0s 552us/step - loss: 0.3372 - accuracy: 0.8377
Epoch 262/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3371 - accuracy: 0.8377
Epoch 263/300
6/6 [==============================] - 0s 573us/step - loss: 0.3368 - accuracy: 0.8377
Epoch 264/300
6/6 [==============================] - 0s 571us/step - loss: 0.3368 - accuracy: 0.8377
Epoch 265/300
6/6 [==============================] - 0s 558us/step - loss: 0.3366 - accuracy: 0.8377
Epoch 266/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3363 - accuracy: 0.8377
Epoch 267/300
6/6 [==============================] - 0s 601us/step - loss: 0.3362 - accuracy: 0.8377
Epoch 268/300
6/6 [==============================] - 0s 550us/step - loss: 0.3360 - accuracy: 0.8377
Epoch 269/300
6/6 [==============================] - 0s 566us/step - loss: 0.3358 - accuracy: 0.8377
Epoch 270/300
6/6 [==============================] - 0s 586us/step - loss: 0.3357 - accuracy: 0.8377
Epoch 271/300
6/6 [==============================] - 0s 583us/step - loss: 0.3356 - accuracy: 0.8377
Epoch 272/300
6/6 [==============================] - 0s 539us/step - loss: 0.3354 - accuracy: 0.8377
Epoch 273/300
6/6 [==============================] - 0s 564us/step - loss: 0.3352 - accuracy: 0.8377
Epoch 274/300
6/6 [==============================] - 0s 580us/step - loss: 0.3349 - accuracy: 0.8377
Epoch 275/300
6/6 [==============================] - 0s 544us/step - loss: 0.3346 - accuracy: 0.8377
Epoch 276/300
6/6 [==============================] - 0s 568us/step - loss: 0.3345 - accuracy: 0.8377
Epoch 277/300
6/6 [==============================] - 0s 568us/step - loss: 0.3343 - accuracy: 0.8377
Epoch 278/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3339 - accuracy: 0.8377
Epoch 279/300
6/6 [==============================] - 0s 579us/step - loss: 0.3339 - accuracy: 0.8377
Epoch 280/300
6/6 [==============================] - 0s 573us/step - loss: 0.3334 - accuracy: 0.8377
Epoch 281/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3334 - accuracy: 0.8377
Epoch 282/300
6/6 [==============================] - 0s 559us/step - loss: 0.3332 - accuracy: 0.8377
Epoch 283/300
6/6 [==============================] - 0s 548us/step - loss: 0.3332 - accuracy: 0.8377
Epoch 284/300
6/6 [==============================] - 0s 585us/step - loss: 0.3330 - accuracy: 0.8377
Epoch 285/300
6/6 [==============================] - 0s 547us/step - loss: 0.3326 - accuracy: 0.8377
Epoch 286/300
6/6 [==============================] - 0s 571us/step - loss: 0.3326 - accuracy: 0.8377
Epoch 287/300
6/6 [==============================] - 0s 562us/step - loss: 0.3324 - accuracy: 0.8377
Epoch 288/300
6/6 [==============================] - 0s 574us/step - loss: 0.3322 - accuracy: 0.8377
Epoch 289/300
6/6 [==============================] - 0s 565us/step - loss: 0.3322 - accuracy: 0.8377
Epoch 290/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3320 - accuracy: 0.8377
Epoch 291/300
6/6 [==============================] - 0s 552us/step - loss: 0.3321 - accuracy: 0.8377
Epoch 292/300
6/6 [==============================] - 0s 562us/step - loss: 0.3316 - accuracy: 0.8377
Epoch 293/300
6/6 [==============================] - 0s 567us/step - loss: 0.3314 - accuracy: 0.8377
Epoch 294/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3313 - accuracy: 0.8377
Epoch 295/300
6/6 [==============================] - 0s 540us/step - loss: 0.3309 - accuracy: 0.8377
Epoch 296/300
6/6 [==============================] - 0s 550us/step - loss: 0.3309 - accuracy: 0.8377
Epoch 297/300
6/6 [==============================] - 0s 546us/step - loss: 0.3312 - accuracy: 0.8348
Epoch 298/300
6/6 [==============================] - 0s 552us/step - loss: 0.3305 - accuracy: 0.8406
Epoch 299/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3302 - accuracy: 0.8406
Epoch 300/300
6/6 [==============================] - 0s 560us/step - loss: 0.3302 - accuracy: 0.8377
Epoch 1/300
6/6 [==============================] - 0s 9ms/step - loss: 0.6540 - accuracy: 0.6754
Epoch 2/300
6/6 [==============================] - 0s 569us/step - loss: 0.6416 - accuracy: 0.6812
Epoch 3/300
6/6 [==============================] - 0s 15ms/step - loss: 0.6286 - accuracy: 0.6957
Epoch 4/300
6/6 [==============================] - 0s 570us/step - loss: 0.6173 - accuracy: 0.6986
Epoch 5/300
6/6 [==============================] - 0s 556us/step - loss: 0.6066 - accuracy: 0.7043
Epoch 6/300
6/6 [==============================] - 0s 568us/step - loss: 0.5963 - accuracy: 0.7101
Epoch 7/300
6/6 [==============================] - 0s 580us/step - loss: 0.5858 - accuracy: 0.7246
Epoch 8/300
6/6 [==============================] - 0s 564us/step - loss: 0.5763 - accuracy: 0.7217
Epoch 9/300
6/6 [==============================] - 0s 546us/step - loss: 0.5671 - accuracy: 0.7246
Epoch 10/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5593 - accuracy: 0.7217
Epoch 11/300
6/6 [==============================] - 0s 581us/step - loss: 0.5509 - accuracy: 0.7217
Epoch 12/300
6/6 [==============================] - 0s 564us/step - loss: 0.5433 - accuracy: 0.7217
Epoch 13/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5366 - accuracy: 0.7275
Epoch 14/300
6/6 [==============================] - 0s 575us/step - loss: 0.5298 - accuracy: 0.7333
Epoch 15/300
6/6 [==============================] - 0s 575us/step - loss: 0.5237 - accuracy: 0.7420
Epoch 16/300
6/6 [==============================] - 0s 577us/step - loss: 0.5176 - accuracy: 0.7478
Epoch 17/300
6/6 [==============================] - 0s 588us/step - loss: 0.5121 - accuracy: 0.7536
Epoch 18/300
6/6 [==============================] - 0s 559us/step - loss: 0.5067 - accuracy: 0.7652
Epoch 19/300
6/6 [==============================] - 0s 574us/step - loss: 0.5014 - accuracy: 0.7739
Epoch 20/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4965 - accuracy: 0.7739
Epoch 21/300
6/6 [==============================] - 0s 541us/step - loss: 0.4922 - accuracy: 0.7710
Epoch 22/300
6/6 [==============================] - 0s 555us/step - loss: 0.4878 - accuracy: 0.7739
Epoch 23/300
6/6 [==============================] - 0s 562us/step - loss: 0.4839 - accuracy: 0.7768
Epoch 24/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4796 - accuracy: 0.7797
Epoch 25/300
6/6 [==============================] - 0s 537us/step - loss: 0.4761 - accuracy: 0.7826
Epoch 26/300
6/6 [==============================] - 0s 572us/step - loss: 0.4728 - accuracy: 0.7855
Epoch 27/300
6/6 [==============================] - 0s 565us/step - loss: 0.4697 - accuracy: 0.7884
Epoch 28/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4670 - accuracy: 0.7884
Epoch 29/300
6/6 [==============================] - 0s 563us/step - loss: 0.4642 - accuracy: 0.7913
Epoch 30/300
6/6 [==============================] - 0s 630us/step - loss: 0.4617 - accuracy: 0.7913
Epoch 31/300
6/6 [==============================] - 0s 603us/step - loss: 0.4592 - accuracy: 0.7913
Epoch 32/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4571 - accuracy: 0.7942
Epoch 33/300
6/6 [==============================] - 0s 585us/step - loss: 0.4550 - accuracy: 0.7971
Epoch 34/300
6/6 [==============================] - 0s 569us/step - loss: 0.4530 - accuracy: 0.7971
Epoch 35/300
6/6 [==============================] - 0s 579us/step - loss: 0.4508 - accuracy: 0.7971
Epoch 36/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4490 - accuracy: 0.7971
Epoch 37/300
6/6 [==============================] - 0s 627us/step - loss: 0.4472 - accuracy: 0.8000
Epoch 38/300
6/6 [==============================] - 0s 593us/step - loss: 0.4452 - accuracy: 0.8058
Epoch 39/300
6/6 [==============================] - 0s 602us/step - loss: 0.4436 - accuracy: 0.8116
Epoch 40/300
6/6 [==============================] - 0s 660us/step - loss: 0.4417 - accuracy: 0.8116
Epoch 41/300
6/6 [==============================] - 0s 618us/step - loss: 0.4403 - accuracy: 0.8116
Epoch 42/300
6/6 [==============================] - 0s 647us/step - loss: 0.4389 - accuracy: 0.8174
Epoch 43/300
6/6 [==============================] - 0s 614us/step - loss: 0.4375 - accuracy: 0.8174
Epoch 44/300
6/6 [==============================] - 0s 660us/step - loss: 0.4365 - accuracy: 0.8145
Epoch 45/300
6/6 [==============================] - 0s 654us/step - loss: 0.4349 - accuracy: 0.8145
Epoch 46/300
6/6 [==============================] - 0s 621us/step - loss: 0.4339 - accuracy: 0.8145
Epoch 47/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4327 - accuracy: 0.8145
Epoch 48/300
6/6 [==============================] - 0s 583us/step - loss: 0.4314 - accuracy: 0.8145
Epoch 49/300
6/6 [==============================] - 0s 608us/step - loss: 0.4305 - accuracy: 0.8145
Epoch 50/300
6/6 [==============================] - 0s 573us/step - loss: 0.4293 - accuracy: 0.8203
Epoch 51/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4282 - accuracy: 0.8203
Epoch 52/300
6/6 [==============================] - 0s 630us/step - loss: 0.4272 - accuracy: 0.8203
Epoch 53/300
6/6 [==============================] - 0s 640us/step - loss: 0.4263 - accuracy: 0.8203
Epoch 54/300
6/6 [==============================] - 0s 651us/step - loss: 0.4251 - accuracy: 0.8174
Epoch 55/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4243 - accuracy: 0.8203
Epoch 56/300
6/6 [==============================] - 0s 559us/step - loss: 0.4234 - accuracy: 0.8203
Epoch 57/300
6/6 [==============================] - 0s 615us/step - loss: 0.4226 - accuracy: 0.8232
Epoch 58/300
6/6 [==============================] - 0s 636us/step - loss: 0.4216 - accuracy: 0.8232
Epoch 59/300
6/6 [==============================] - 0s 658us/step - loss: 0.4208 - accuracy: 0.8232
Epoch 60/300
6/6 [==============================] - 0s 621us/step - loss: 0.4199 - accuracy: 0.8232
Epoch 61/300
6/6 [==============================] - 0s 607us/step - loss: 0.4192 - accuracy: 0.8232
Epoch 62/300
6/6 [==============================] - 0s 578us/step - loss: 0.4184 - accuracy: 0.8203
Epoch 63/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4177 - accuracy: 0.8145
Epoch 64/300
6/6 [==============================] - 0s 638us/step - loss: 0.4169 - accuracy: 0.8145
Epoch 65/300
6/6 [==============================] - 0s 638us/step - loss: 0.4162 - accuracy: 0.8145
Epoch 66/300
6/6 [==============================] - 0s 661us/step - loss: 0.4153 - accuracy: 0.8145
Epoch 67/300
6/6 [==============================] - 0s 645us/step - loss: 0.4146 - accuracy: 0.8145
Epoch 68/300
6/6 [==============================] - 0s 667us/step - loss: 0.4138 - accuracy: 0.8145
Epoch 69/300
6/6 [==============================] - 0s 664us/step - loss: 0.4131 - accuracy: 0.8145
Epoch 70/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4123 - accuracy: 0.8145
Epoch 71/300
6/6 [==============================] - 0s 592us/step - loss: 0.4117 - accuracy: 0.8145
Epoch 72/300
6/6 [==============================] - 0s 622us/step - loss: 0.4111 - accuracy: 0.8145
Epoch 73/300
6/6 [==============================] - 0s 649us/step - loss: 0.4103 - accuracy: 0.8145
Epoch 74/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4097 - accuracy: 0.8145
Epoch 75/300
6/6 [==============================] - 0s 635us/step - loss: 0.4092 - accuracy: 0.8116
Epoch 76/300
6/6 [==============================] - 0s 677us/step - loss: 0.4086 - accuracy: 0.8145
Epoch 77/300
6/6 [==============================] - 0s 672us/step - loss: 0.4078 - accuracy: 0.8174
Epoch 78/300
6/6 [==============================] - 0s 667us/step - loss: 0.4073 - accuracy: 0.8174
Epoch 79/300
6/6 [==============================] - 0s 644us/step - loss: 0.4068 - accuracy: 0.8174
Epoch 80/300
6/6 [==============================] - 0s 651us/step - loss: 0.4061 - accuracy: 0.8174
Epoch 81/300
6/6 [==============================] - 0s 630us/step - loss: 0.4057 - accuracy: 0.8174
Epoch 82/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4051 - accuracy: 0.8203
Epoch 83/300
6/6 [==============================] - 0s 675us/step - loss: 0.4046 - accuracy: 0.8203
Epoch 84/300
6/6 [==============================] - 0s 667us/step - loss: 0.4043 - accuracy: 0.8203
Epoch 85/300
6/6 [==============================] - 0s 603us/step - loss: 0.4036 - accuracy: 0.8203
Epoch 86/300
6/6 [==============================] - 0s 658us/step - loss: 0.4029 - accuracy: 0.8203
Epoch 87/300
6/6 [==============================] - 0s 606us/step - loss: 0.4026 - accuracy: 0.8145
Epoch 88/300
6/6 [==============================] - 0s 601us/step - loss: 0.4020 - accuracy: 0.8145
Epoch 89/300
6/6 [==============================] - 0s 640us/step - loss: 0.4014 - accuracy: 0.8145
Epoch 90/300
6/6 [==============================] - 0s 696us/step - loss: 0.4009 - accuracy: 0.8145
Epoch 91/300
6/6 [==============================] - 0s 631us/step - loss: 0.4004 - accuracy: 0.8145
Epoch 92/300
6/6 [==============================] - 0s 661us/step - loss: 0.3998 - accuracy: 0.8116
Epoch 93/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3993 - accuracy: 0.8145
Epoch 94/300
6/6 [==============================] - 0s 659us/step - loss: 0.3986 - accuracy: 0.8145
Epoch 95/300
6/6 [==============================] - 0s 653us/step - loss: 0.3980 - accuracy: 0.8145
Epoch 96/300
6/6 [==============================] - 0s 667us/step - loss: 0.3974 - accuracy: 0.8145
Epoch 97/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3969 - accuracy: 0.8116
Epoch 98/300
6/6 [==============================] - 0s 624us/step - loss: 0.3962 - accuracy: 0.8116
Epoch 99/300
6/6 [==============================] - 0s 638us/step - loss: 0.3957 - accuracy: 0.8116
Epoch 100/300
6/6 [==============================] - 0s 617us/step - loss: 0.3953 - accuracy: 0.8145
Epoch 101/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3947 - accuracy: 0.8145
Epoch 102/300
6/6 [==============================] - 0s 612us/step - loss: 0.3943 - accuracy: 0.8145
Epoch 103/300
6/6 [==============================] - 0s 608us/step - loss: 0.3937 - accuracy: 0.8145
Epoch 104/300
6/6 [==============================] - 0s 658us/step - loss: 0.3933 - accuracy: 0.8145
Epoch 105/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3929 - accuracy: 0.8174
Epoch 106/300
6/6 [==============================] - 0s 615us/step - loss: 0.3924 - accuracy: 0.8174
Epoch 107/300
6/6 [==============================] - 0s 653us/step - loss: 0.3921 - accuracy: 0.8174
Epoch 108/300
6/6 [==============================] - 0s 640us/step - loss: 0.3915 - accuracy: 0.8174
Epoch 109/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3910 - accuracy: 0.8174
Epoch 110/300
6/6 [==============================] - 0s 633us/step - loss: 0.3906 - accuracy: 0.8203
Epoch 111/300
6/6 [==============================] - 0s 634us/step - loss: 0.3901 - accuracy: 0.8232
Epoch 112/300
6/6 [==============================] - 0s 560us/step - loss: 0.3898 - accuracy: 0.8232
Epoch 113/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3892 - accuracy: 0.8232
Epoch 114/300
6/6 [==============================] - 0s 630us/step - loss: 0.3888 - accuracy: 0.8232
Epoch 115/300
6/6 [==============================] - 0s 663us/step - loss: 0.3884 - accuracy: 0.8261
Epoch 116/300
6/6 [==============================] - 0s 606us/step - loss: 0.3881 - accuracy: 0.8261
Epoch 117/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3877 - accuracy: 0.8261
Epoch 118/300
6/6 [==============================] - 0s 654us/step - loss: 0.3872 - accuracy: 0.8261
Epoch 119/300
6/6 [==============================] - 0s 610us/step - loss: 0.3868 - accuracy: 0.8261
Epoch 120/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3863 - accuracy: 0.8261
Epoch 121/300
6/6 [==============================] - 0s 616us/step - loss: 0.3860 - accuracy: 0.8290
Epoch 122/300
6/6 [==============================] - 0s 641us/step - loss: 0.3857 - accuracy: 0.8290
Epoch 123/300
6/6 [==============================] - 0s 634us/step - loss: 0.3853 - accuracy: 0.8290
Epoch 124/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3851 - accuracy: 0.8261
Epoch 125/300
6/6 [==============================] - 0s 603us/step - loss: 0.3845 - accuracy: 0.8290
Epoch 126/300
6/6 [==============================] - 0s 593us/step - loss: 0.3841 - accuracy: 0.8319
Epoch 127/300
6/6 [==============================] - 0s 652us/step - loss: 0.3838 - accuracy: 0.8319
Epoch 128/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3835 - accuracy: 0.8319
Epoch 129/300
6/6 [==============================] - 0s 607us/step - loss: 0.3829 - accuracy: 0.8319
Epoch 130/300
6/6 [==============================] - 0s 664us/step - loss: 0.3824 - accuracy: 0.8319
Epoch 131/300
6/6 [==============================] - 0s 635us/step - loss: 0.3822 - accuracy: 0.8319
Epoch 132/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3819 - accuracy: 0.8377
Epoch 133/300
6/6 [==============================] - 0s 648us/step - loss: 0.3814 - accuracy: 0.8377
Epoch 134/300
6/6 [==============================] - 0s 614us/step - loss: 0.3811 - accuracy: 0.8348
Epoch 135/300
6/6 [==============================] - 0s 616us/step - loss: 0.3808 - accuracy: 0.8290
Epoch 136/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3805 - accuracy: 0.8290
Epoch 137/300
6/6 [==============================] - 0s 561us/step - loss: 0.3801 - accuracy: 0.8290
Epoch 138/300
6/6 [==============================] - 0s 598us/step - loss: 0.3799 - accuracy: 0.8290
Epoch 139/300
6/6 [==============================] - 0s 633us/step - loss: 0.3797 - accuracy: 0.8290
Epoch 140/300
6/6 [==============================] - 0s 632us/step - loss: 0.3793 - accuracy: 0.8290
Epoch 141/300
6/6 [==============================] - 0s 649us/step - loss: 0.3790 - accuracy: 0.8290
Epoch 142/300
6/6 [==============================] - 0s 675us/step - loss: 0.3786 - accuracy: 0.8290
Epoch 143/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3783 - accuracy: 0.8348
Epoch 144/300
6/6 [==============================] - 0s 658us/step - loss: 0.3780 - accuracy: 0.8348
Epoch 145/300
6/6 [==============================] - 0s 634us/step - loss: 0.3777 - accuracy: 0.8348
Epoch 146/300
6/6 [==============================] - 0s 642us/step - loss: 0.3774 - accuracy: 0.8319
Epoch 147/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3771 - accuracy: 0.8319
Epoch 148/300
6/6 [==============================] - 0s 638us/step - loss: 0.3770 - accuracy: 0.8319
Epoch 149/300
6/6 [==============================] - 0s 652us/step - loss: 0.3766 - accuracy: 0.8319
Epoch 150/300
6/6 [==============================] - 0s 649us/step - loss: 0.3764 - accuracy: 0.8319
Epoch 151/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3761 - accuracy: 0.8319
Epoch 152/300
6/6 [==============================] - 0s 609us/step - loss: 0.3757 - accuracy: 0.8348
Epoch 153/300
6/6 [==============================] - 0s 608us/step - loss: 0.3756 - accuracy: 0.8319
Epoch 154/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3751 - accuracy: 0.8319
Epoch 155/300
6/6 [==============================] - 0s 637us/step - loss: 0.3749 - accuracy: 0.8319
Epoch 156/300
6/6 [==============================] - 0s 620us/step - loss: 0.3746 - accuracy: 0.8319
Epoch 157/300
6/6 [==============================] - 0s 596us/step - loss: 0.3744 - accuracy: 0.8348
Epoch 158/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3741 - accuracy: 0.8319
Epoch 159/300
6/6 [==============================] - 0s 631us/step - loss: 0.3742 - accuracy: 0.8348
Epoch 160/300
6/6 [==============================] - 0s 629us/step - loss: 0.3736 - accuracy: 0.8319
Epoch 161/300
6/6 [==============================] - 0s 646us/step - loss: 0.3734 - accuracy: 0.8319
Epoch 162/300
6/6 [==============================] - 0s 671us/step - loss: 0.3731 - accuracy: 0.8348
Epoch 163/300
6/6 [==============================] - 0s 595us/step - loss: 0.3731 - accuracy: 0.8348
Epoch 164/300
6/6 [==============================] - 0s 647us/step - loss: 0.3729 - accuracy: 0.8348
Epoch 165/300
6/6 [==============================] - 0s 655us/step - loss: 0.3726 - accuracy: 0.8348
Epoch 166/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3722 - accuracy: 0.8348
Epoch 167/300
6/6 [==============================] - 0s 637us/step - loss: 0.3720 - accuracy: 0.8348
Epoch 168/300
6/6 [==============================] - 0s 625us/step - loss: 0.3717 - accuracy: 0.8348
Epoch 169/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3714 - accuracy: 0.8319
Epoch 170/300
6/6 [==============================] - 0s 640us/step - loss: 0.3712 - accuracy: 0.8319
Epoch 171/300
6/6 [==============================] - 0s 604us/step - loss: 0.3709 - accuracy: 0.8290
Epoch 172/300
6/6 [==============================] - 0s 663us/step - loss: 0.3706 - accuracy: 0.8290
Epoch 173/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3704 - accuracy: 0.8319
Epoch 174/300
6/6 [==============================] - 0s 634us/step - loss: 0.3700 - accuracy: 0.8319
Epoch 175/300
6/6 [==============================] - 0s 624us/step - loss: 0.3699 - accuracy: 0.8290
Epoch 176/300
6/6 [==============================] - 0s 654us/step - loss: 0.3696 - accuracy: 0.8290
Epoch 177/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3695 - accuracy: 0.8261
Epoch 178/300
6/6 [==============================] - 0s 648us/step - loss: 0.3691 - accuracy: 0.8290
Epoch 179/300
6/6 [==============================] - 0s 580us/step - loss: 0.3688 - accuracy: 0.8290
Epoch 180/300
6/6 [==============================] - 0s 560us/step - loss: 0.3686 - accuracy: 0.8290
Epoch 181/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3683 - accuracy: 0.8290
Epoch 182/300
6/6 [==============================] - 0s 569us/step - loss: 0.3680 - accuracy: 0.8319
Epoch 183/300
6/6 [==============================] - 0s 561us/step - loss: 0.3678 - accuracy: 0.8319
Epoch 184/300
6/6 [==============================] - 0s 533us/step - loss: 0.3677 - accuracy: 0.8319
Epoch 185/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3674 - accuracy: 0.8290
Epoch 186/300
6/6 [==============================] - 0s 560us/step - loss: 0.3671 - accuracy: 0.8290
Epoch 187/300
6/6 [==============================] - 0s 574us/step - loss: 0.3669 - accuracy: 0.8290
Epoch 188/300
6/6 [==============================] - 0s 550us/step - loss: 0.3667 - accuracy: 0.8290
Epoch 189/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3666 - accuracy: 0.8290
Epoch 190/300
6/6 [==============================] - 0s 581us/step - loss: 0.3662 - accuracy: 0.8290
Epoch 191/300
6/6 [==============================] - 0s 565us/step - loss: 0.3660 - accuracy: 0.8319
Epoch 192/300
6/6 [==============================] - 0s 567us/step - loss: 0.3659 - accuracy: 0.8290
Epoch 193/300
6/6 [==============================] - 0s 641us/step - loss: 0.3657 - accuracy: 0.8290
Epoch 194/300
6/6 [==============================] - 0s 564us/step - loss: 0.3653 - accuracy: 0.8319
Epoch 195/300
6/6 [==============================] - 0s 583us/step - loss: 0.3652 - accuracy: 0.8319
Epoch 196/300
6/6 [==============================] - 0s 545us/step - loss: 0.3650 - accuracy: 0.8319
Epoch 197/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3648 - accuracy: 0.8319
Epoch 198/300
6/6 [==============================] - 0s 571us/step - loss: 0.3646 - accuracy: 0.8319
Epoch 199/300
6/6 [==============================] - 0s 561us/step - loss: 0.3644 - accuracy: 0.8319
Epoch 200/300
6/6 [==============================] - 0s 549us/step - loss: 0.3642 - accuracy: 0.8319
Epoch 201/300
6/6 [==============================] - 0s 561us/step - loss: 0.3640 - accuracy: 0.8319
Epoch 202/300
6/6 [==============================] - 0s 556us/step - loss: 0.3638 - accuracy: 0.8348
Epoch 203/300
6/6 [==============================] - 0s 567us/step - loss: 0.3635 - accuracy: 0.8348
Epoch 204/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3633 - accuracy: 0.8348
Epoch 205/300
6/6 [==============================] - 0s 599us/step - loss: 0.3631 - accuracy: 0.8348
Epoch 206/300
6/6 [==============================] - 0s 599us/step - loss: 0.3631 - accuracy: 0.8348
Epoch 207/300
6/6 [==============================] - 0s 588us/step - loss: 0.3628 - accuracy: 0.8348
Epoch 208/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3627 - accuracy: 0.8348
Epoch 209/300
6/6 [==============================] - 0s 597us/step - loss: 0.3624 - accuracy: 0.8348
Epoch 210/300
6/6 [==============================] - 0s 594us/step - loss: 0.3621 - accuracy: 0.8348
Epoch 211/300
6/6 [==============================] - 0s 568us/step - loss: 0.3620 - accuracy: 0.8377
Epoch 212/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3619 - accuracy: 0.8377
Epoch 213/300
6/6 [==============================] - 0s 586us/step - loss: 0.3617 - accuracy: 0.8406
Epoch 214/300
6/6 [==============================] - 0s 586us/step - loss: 0.3616 - accuracy: 0.8377
Epoch 215/300
6/6 [==============================] - 0s 579us/step - loss: 0.3615 - accuracy: 0.8377
Epoch 216/300
6/6 [==============================] - 0s 575us/step - loss: 0.3613 - accuracy: 0.8377
Epoch 217/300
6/6 [==============================] - 0s 625us/step - loss: 0.3611 - accuracy: 0.8348
Epoch 218/300
6/6 [==============================] - 0s 547us/step - loss: 0.3607 - accuracy: 0.8348
Epoch 219/300
6/6 [==============================] - 0s 547us/step - loss: 0.3607 - accuracy: 0.8377
Epoch 220/300
6/6 [==============================] - 0s 554us/step - loss: 0.3604 - accuracy: 0.8377
Epoch 221/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3603 - accuracy: 0.8377
Epoch 222/300
6/6 [==============================] - 0s 561us/step - loss: 0.3603 - accuracy: 0.8377
Epoch 223/300
6/6 [==============================] - 0s 552us/step - loss: 0.3601 - accuracy: 0.8406
Epoch 224/300
6/6 [==============================] - 0s 559us/step - loss: 0.3599 - accuracy: 0.8377
Epoch 225/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3597 - accuracy: 0.8406
Epoch 226/300
6/6 [==============================] - 0s 568us/step - loss: 0.3598 - accuracy: 0.8377
Epoch 227/300
6/6 [==============================] - 0s 564us/step - loss: 0.3595 - accuracy: 0.8377
Epoch 228/300
6/6 [==============================] - 0s 541us/step - loss: 0.3592 - accuracy: 0.8377
Epoch 229/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3592 - accuracy: 0.8377
Epoch 230/300
6/6 [==============================] - 0s 565us/step - loss: 0.3589 - accuracy: 0.8377
Epoch 231/300
6/6 [==============================] - 0s 544us/step - loss: 0.3588 - accuracy: 0.8377
Epoch 232/300
6/6 [==============================] - 0s 556us/step - loss: 0.3585 - accuracy: 0.8377
Epoch 233/300
6/6 [==============================] - 0s 582us/step - loss: 0.3584 - accuracy: 0.8377
Epoch 234/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3582 - accuracy: 0.8377
Epoch 235/300
6/6 [==============================] - 0s 546us/step - loss: 0.3582 - accuracy: 0.8348
Epoch 236/300
6/6 [==============================] - 0s 545us/step - loss: 0.3579 - accuracy: 0.8348
Epoch 237/300
6/6 [==============================] - 0s 542us/step - loss: 0.3579 - accuracy: 0.8348
Epoch 238/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3575 - accuracy: 0.8377
Epoch 239/300
6/6 [==============================] - 0s 546us/step - loss: 0.3575 - accuracy: 0.8377
Epoch 240/300
6/6 [==============================] - 0s 555us/step - loss: 0.3572 - accuracy: 0.8377
Epoch 241/300
6/6 [==============================] - 0s 548us/step - loss: 0.3570 - accuracy: 0.8377
Epoch 242/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3569 - accuracy: 0.8377
Epoch 243/300
6/6 [==============================] - 0s 554us/step - loss: 0.3568 - accuracy: 0.8406
Epoch 244/300
6/6 [==============================] - 0s 547us/step - loss: 0.3567 - accuracy: 0.8406
Epoch 245/300
6/6 [==============================] - 0s 546us/step - loss: 0.3564 - accuracy: 0.8406
Epoch 246/300
6/6 [==============================] - 0s 534us/step - loss: 0.3563 - accuracy: 0.8377
Epoch 247/300
6/6 [==============================] - 0s 549us/step - loss: 0.3565 - accuracy: 0.8377
Epoch 248/300
6/6 [==============================] - 0s 555us/step - loss: 0.3562 - accuracy: 0.8406
Epoch 249/300
6/6 [==============================] - 0s 542us/step - loss: 0.3559 - accuracy: 0.8377
Epoch 250/300
6/6 [==============================] - 0s 542us/step - loss: 0.3558 - accuracy: 0.8377
Epoch 251/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3556 - accuracy: 0.8377
Epoch 252/300
6/6 [==============================] - 0s 563us/step - loss: 0.3554 - accuracy: 0.8377
Epoch 253/300
6/6 [==============================] - 0s 534us/step - loss: 0.3552 - accuracy: 0.8377
Epoch 254/300
6/6 [==============================] - 0s 552us/step - loss: 0.3550 - accuracy: 0.8406
Epoch 255/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3550 - accuracy: 0.8406
Epoch 256/300
6/6 [==============================] - 0s 567us/step - loss: 0.3548 - accuracy: 0.8406
Epoch 257/300
6/6 [==============================] - 0s 538us/step - loss: 0.3546 - accuracy: 0.8406
Epoch 258/300
6/6 [==============================] - 0s 538us/step - loss: 0.3545 - accuracy: 0.8406
Epoch 259/300
6/6 [==============================] - 0s 545us/step - loss: 0.3544 - accuracy: 0.8406
Epoch 260/300
6/6 [==============================] - 0s 581us/step - loss: 0.3540 - accuracy: 0.8406
Epoch 261/300
6/6 [==============================] - 0s 557us/step - loss: 0.3539 - accuracy: 0.8406
Epoch 262/300
6/6 [==============================] - 0s 522us/step - loss: 0.3538 - accuracy: 0.8435
Epoch 263/300
6/6 [==============================] - 0s 554us/step - loss: 0.3535 - accuracy: 0.8406
Epoch 264/300
6/6 [==============================] - 0s 539us/step - loss: 0.3534 - accuracy: 0.8406
Epoch 265/300
6/6 [==============================] - 0s 537us/step - loss: 0.3536 - accuracy: 0.8406
Epoch 266/300
6/6 [==============================] - 0s 528us/step - loss: 0.3531 - accuracy: 0.8406
Epoch 267/300
6/6 [==============================] - 0s 517us/step - loss: 0.3529 - accuracy: 0.8406
Epoch 268/300
6/6 [==============================] - 0s 521us/step - loss: 0.3529 - accuracy: 0.8406
Epoch 269/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3527 - accuracy: 0.8435
Epoch 270/300
6/6 [==============================] - 0s 540us/step - loss: 0.3527 - accuracy: 0.8406
Epoch 271/300
6/6 [==============================] - 0s 537us/step - loss: 0.3524 - accuracy: 0.8406
Epoch 272/300
6/6 [==============================] - 0s 530us/step - loss: 0.3521 - accuracy: 0.8435
Epoch 273/300
6/6 [==============================] - 0s 527us/step - loss: 0.3519 - accuracy: 0.8435
Epoch 274/300
6/6 [==============================] - 0s 541us/step - loss: 0.3516 - accuracy: 0.8435
Epoch 275/300
6/6 [==============================] - 0s 524us/step - loss: 0.3515 - accuracy: 0.8435
Epoch 276/300
6/6 [==============================] - 0s 527us/step - loss: 0.3512 - accuracy: 0.8435
Epoch 277/300
6/6 [==============================] - 0s 524us/step - loss: 0.3511 - accuracy: 0.8464
Epoch 278/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3510 - accuracy: 0.8435
Epoch 279/300
6/6 [==============================] - 0s 538us/step - loss: 0.3507 - accuracy: 0.8435
Epoch 280/300
6/6 [==============================] - 0s 534us/step - loss: 0.3506 - accuracy: 0.8435
Epoch 281/300
6/6 [==============================] - 0s 521us/step - loss: 0.3504 - accuracy: 0.8435
Epoch 282/300
6/6 [==============================] - 0s 522us/step - loss: 0.3503 - accuracy: 0.8464
Epoch 283/300
6/6 [==============================] - 0s 539us/step - loss: 0.3500 - accuracy: 0.8493
Epoch 284/300
6/6 [==============================] - 0s 530us/step - loss: 0.3500 - accuracy: 0.8493
Epoch 285/300
6/6 [==============================] - 0s 536us/step - loss: 0.3496 - accuracy: 0.8493
Epoch 286/300
6/6 [==============================] - 0s 526us/step - loss: 0.3494 - accuracy: 0.8493
Epoch 287/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3495 - accuracy: 0.8464
Epoch 288/300
6/6 [==============================] - 0s 591us/step - loss: 0.3494 - accuracy: 0.8464
Epoch 289/300
6/6 [==============================] - 0s 630us/step - loss: 0.3490 - accuracy: 0.8493
Epoch 290/300
6/6 [==============================] - 0s 597us/step - loss: 0.3489 - accuracy: 0.8493
Epoch 291/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3487 - accuracy: 0.8493
Epoch 292/300
6/6 [==============================] - 0s 648us/step - loss: 0.3488 - accuracy: 0.8464
Epoch 293/300
6/6 [==============================] - 0s 612us/step - loss: 0.3485 - accuracy: 0.8493
Epoch 294/300
6/6 [==============================] - 0s 559us/step - loss: 0.3484 - accuracy: 0.8464
Epoch 295/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3482 - accuracy: 0.8464
Epoch 296/300
6/6 [==============================] - 0s 738us/step - loss: 0.3482 - accuracy: 0.8406
Epoch 297/300
6/6 [==============================] - 0s 578us/step - loss: 0.3480 - accuracy: 0.8435
Epoch 298/300
6/6 [==============================] - 0s 583us/step - loss: 0.3480 - accuracy: 0.8435
Epoch 299/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3477 - accuracy: 0.8464
Epoch 300/300
6/6 [==============================] - 0s 623us/step - loss: 0.3475 - accuracy: 0.8464
Epoch 1/300
6/6 [==============================] - 0s 771us/step - loss: 0.6606 - accuracy: 0.6522
Epoch 2/300
6/6 [==============================] - 0s 620us/step - loss: 0.6485 - accuracy: 0.6580
Epoch 3/300
6/6 [==============================] - 0s 14ms/step - loss: 0.6369 - accuracy: 0.6783
Epoch 4/300
6/6 [==============================] - 0s 590us/step - loss: 0.6264 - accuracy: 0.6812
Epoch 5/300
6/6 [==============================] - 0s 585us/step - loss: 0.6158 - accuracy: 0.6841
Epoch 6/300
6/6 [==============================] - 0s 14ms/step - loss: 0.6063 - accuracy: 0.6899
Epoch 7/300
6/6 [==============================] - 0s 624us/step - loss: 0.5969 - accuracy: 0.7014
Epoch 8/300
6/6 [==============================] - 0s 588us/step - loss: 0.5880 - accuracy: 0.7072
Epoch 9/300
6/6 [==============================] - 0s 15ms/step - loss: 0.5793 - accuracy: 0.7101
Epoch 10/300
6/6 [==============================] - 0s 589us/step - loss: 0.5717 - accuracy: 0.7101
Epoch 11/300
6/6 [==============================] - 0s 622us/step - loss: 0.5639 - accuracy: 0.7101
Epoch 12/300
6/6 [==============================] - 0s 674us/step - loss: 0.5572 - accuracy: 0.7101
Epoch 13/300
6/6 [==============================] - 0s 599us/step - loss: 0.5507 - accuracy: 0.7159
Epoch 14/300
6/6 [==============================] - 0s 576us/step - loss: 0.5447 - accuracy: 0.7217
Epoch 15/300
6/6 [==============================] - 0s 14ms/step - loss: 0.5390 - accuracy: 0.7275
Epoch 16/300
6/6 [==============================] - 0s 595us/step - loss: 0.5336 - accuracy: 0.7362
Epoch 17/300
6/6 [==============================] - 0s 572us/step - loss: 0.5290 - accuracy: 0.7420
Epoch 18/300
6/6 [==============================] - 0s 590us/step - loss: 0.5241 - accuracy: 0.7449
Epoch 19/300
6/6 [==============================] - 0s 591us/step - loss: 0.5193 - accuracy: 0.7478
Epoch 20/300
6/6 [==============================] - 0s 596us/step - loss: 0.5152 - accuracy: 0.7449
Epoch 21/300
6/6 [==============================] - 0s 583us/step - loss: 0.5112 - accuracy: 0.7507
Epoch 22/300
6/6 [==============================] - 0s 13ms/step - loss: 0.5073 - accuracy: 0.7594
Epoch 23/300
6/6 [==============================] - 0s 590us/step - loss: 0.5040 - accuracy: 0.7594
Epoch 24/300
6/6 [==============================] - 0s 589us/step - loss: 0.5000 - accuracy: 0.7623
Epoch 25/300
6/6 [==============================] - 0s 580us/step - loss: 0.4969 - accuracy: 0.7710
Epoch 26/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4939 - accuracy: 0.7710
Epoch 27/300
6/6 [==============================] - 0s 591us/step - loss: 0.4914 - accuracy: 0.7681
Epoch 28/300
6/6 [==============================] - 0s 564us/step - loss: 0.4886 - accuracy: 0.7710
Epoch 29/300
6/6 [==============================] - 0s 580us/step - loss: 0.4861 - accuracy: 0.7710
Epoch 30/300
6/6 [==============================] - 0s 588us/step - loss: 0.4834 - accuracy: 0.7710
Epoch 31/300
6/6 [==============================] - 0s 563us/step - loss: 0.4810 - accuracy: 0.7710
Epoch 32/300
6/6 [==============================] - 0s 571us/step - loss: 0.4789 - accuracy: 0.7768
Epoch 33/300
6/6 [==============================] - 0s 596us/step - loss: 0.4768 - accuracy: 0.7797
Epoch 34/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4752 - accuracy: 0.7826
Epoch 35/300
6/6 [==============================] - 0s 570us/step - loss: 0.4732 - accuracy: 0.7797
Epoch 36/300
6/6 [==============================] - 0s 553us/step - loss: 0.4715 - accuracy: 0.7797
Epoch 37/300
6/6 [==============================] - 0s 563us/step - loss: 0.4702 - accuracy: 0.7797
Epoch 38/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4682 - accuracy: 0.7797
Epoch 39/300
6/6 [==============================] - 0s 576us/step - loss: 0.4669 - accuracy: 0.7826
Epoch 40/300
6/6 [==============================] - 0s 580us/step - loss: 0.4653 - accuracy: 0.7826
Epoch 41/300
6/6 [==============================] - 0s 538us/step - loss: 0.4640 - accuracy: 0.7826
Epoch 42/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4627 - accuracy: 0.7826
Epoch 43/300
6/6 [==============================] - 0s 556us/step - loss: 0.4615 - accuracy: 0.7855
Epoch 44/300
6/6 [==============================] - 0s 546us/step - loss: 0.4602 - accuracy: 0.7884
Epoch 45/300
6/6 [==============================] - 0s 546us/step - loss: 0.4591 - accuracy: 0.7884
Epoch 46/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4578 - accuracy: 0.7913
Epoch 47/300
6/6 [==============================] - 0s 565us/step - loss: 0.4570 - accuracy: 0.7884
Epoch 48/300
6/6 [==============================] - 0s 564us/step - loss: 0.4558 - accuracy: 0.7942
Epoch 49/300
6/6 [==============================] - 0s 584us/step - loss: 0.4547 - accuracy: 0.7942
Epoch 50/300
6/6 [==============================] - 0s 561us/step - loss: 0.4537 - accuracy: 0.7913
Epoch 51/300
6/6 [==============================] - 0s 547us/step - loss: 0.4526 - accuracy: 0.7913
Epoch 52/300
6/6 [==============================] - 0s 540us/step - loss: 0.4516 - accuracy: 0.7913
Epoch 53/300
6/6 [==============================] - 0s 553us/step - loss: 0.4508 - accuracy: 0.7913
Epoch 54/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4496 - accuracy: 0.7913
Epoch 55/300
6/6 [==============================] - 0s 605us/step - loss: 0.4488 - accuracy: 0.7913
Epoch 56/300
6/6 [==============================] - 0s 551us/step - loss: 0.4479 - accuracy: 0.7942
Epoch 57/300
6/6 [==============================] - 0s 576us/step - loss: 0.4471 - accuracy: 0.7971
Epoch 58/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4460 - accuracy: 0.7971
Epoch 59/300
6/6 [==============================] - 0s 614us/step - loss: 0.4455 - accuracy: 0.7971
Epoch 60/300
6/6 [==============================] - 0s 576us/step - loss: 0.4444 - accuracy: 0.7942
Epoch 61/300
6/6 [==============================] - 0s 569us/step - loss: 0.4438 - accuracy: 0.7971
Epoch 62/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4429 - accuracy: 0.7971
Epoch 63/300
6/6 [==============================] - 0s 568us/step - loss: 0.4420 - accuracy: 0.7971
Epoch 64/300
6/6 [==============================] - 0s 559us/step - loss: 0.4413 - accuracy: 0.7971
Epoch 65/300
6/6 [==============================] - 0s 559us/step - loss: 0.4405 - accuracy: 0.7971
Epoch 66/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4397 - accuracy: 0.8000
Epoch 67/300
6/6 [==============================] - 0s 619us/step - loss: 0.4388 - accuracy: 0.8000
Epoch 68/300
6/6 [==============================] - 0s 595us/step - loss: 0.4381 - accuracy: 0.8000
Epoch 69/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4372 - accuracy: 0.8000
Epoch 70/300
6/6 [==============================] - 0s 558us/step - loss: 0.4365 - accuracy: 0.8000
Epoch 71/300
6/6 [==============================] - 0s 594us/step - loss: 0.4358 - accuracy: 0.8000
Epoch 72/300
6/6 [==============================] - 0s 585us/step - loss: 0.4349 - accuracy: 0.8000
Epoch 73/300
6/6 [==============================] - 0s 549us/step - loss: 0.4344 - accuracy: 0.8000
Epoch 74/300
6/6 [==============================] - 0s 592us/step - loss: 0.4335 - accuracy: 0.8029
Epoch 75/300
6/6 [==============================] - 0s 561us/step - loss: 0.4328 - accuracy: 0.8000
Epoch 76/300
6/6 [==============================] - 0s 570us/step - loss: 0.4320 - accuracy: 0.8000
Epoch 77/300
6/6 [==============================] - 0s 543us/step - loss: 0.4313 - accuracy: 0.8000
Epoch 78/300
6/6 [==============================] - 0s 566us/step - loss: 0.4304 - accuracy: 0.8000
Epoch 79/300
6/6 [==============================] - 0s 581us/step - loss: 0.4297 - accuracy: 0.8000
Epoch 80/300
6/6 [==============================] - 0s 576us/step - loss: 0.4288 - accuracy: 0.8029
Epoch 81/300
6/6 [==============================] - 0s 574us/step - loss: 0.4282 - accuracy: 0.8029
Epoch 82/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4274 - accuracy: 0.8000
Epoch 83/300
6/6 [==============================] - 0s 591us/step - loss: 0.4266 - accuracy: 0.8000
Epoch 84/300
6/6 [==============================] - 0s 584us/step - loss: 0.4261 - accuracy: 0.8029
Epoch 85/300
6/6 [==============================] - 0s 566us/step - loss: 0.4251 - accuracy: 0.8029
Epoch 86/300
6/6 [==============================] - 0s 574us/step - loss: 0.4243 - accuracy: 0.8029
Epoch 87/300
6/6 [==============================] - 0s 577us/step - loss: 0.4238 - accuracy: 0.8058
Epoch 88/300
6/6 [==============================] - 0s 566us/step - loss: 0.4231 - accuracy: 0.8087
Epoch 89/300
6/6 [==============================] - 0s 581us/step - loss: 0.4224 - accuracy: 0.8087
Epoch 90/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4218 - accuracy: 0.8087
Epoch 91/300
6/6 [==============================] - 0s 565us/step - loss: 0.4212 - accuracy: 0.8116
Epoch 92/300
6/6 [==============================] - 0s 575us/step - loss: 0.4207 - accuracy: 0.8116
Epoch 93/300
6/6 [==============================] - 0s 548us/step - loss: 0.4200 - accuracy: 0.8116
Epoch 94/300
6/6 [==============================] - 0s 14ms/step - loss: 0.4194 - accuracy: 0.8087
Epoch 95/300
6/6 [==============================] - 0s 547us/step - loss: 0.4189 - accuracy: 0.8058
Epoch 96/300
6/6 [==============================] - 0s 551us/step - loss: 0.4184 - accuracy: 0.8058
Epoch 97/300
6/6 [==============================] - 0s 549us/step - loss: 0.4178 - accuracy: 0.8087
Epoch 98/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4171 - accuracy: 0.8087
Epoch 99/300
6/6 [==============================] - 0s 599us/step - loss: 0.4167 - accuracy: 0.8058
Epoch 100/300
6/6 [==============================] - 0s 593us/step - loss: 0.4159 - accuracy: 0.8058
Epoch 101/300
6/6 [==============================] - 0s 585us/step - loss: 0.4154 - accuracy: 0.8058
Epoch 102/300
6/6 [==============================] - 0s 621us/step - loss: 0.4151 - accuracy: 0.8058
Epoch 103/300
6/6 [==============================] - 0s 580us/step - loss: 0.4143 - accuracy: 0.8029
Epoch 104/300
6/6 [==============================] - 0s 586us/step - loss: 0.4138 - accuracy: 0.8058
Epoch 105/300
6/6 [==============================] - 0s 578us/step - loss: 0.4134 - accuracy: 0.8087
Epoch 106/300
6/6 [==============================] - 0s 566us/step - loss: 0.4126 - accuracy: 0.8087
Epoch 107/300
6/6 [==============================] - 0s 597us/step - loss: 0.4122 - accuracy: 0.8087
Epoch 108/300
6/6 [==============================] - 0s 566us/step - loss: 0.4117 - accuracy: 0.8087
Epoch 109/300
6/6 [==============================] - 0s 598us/step - loss: 0.4110 - accuracy: 0.8087
Epoch 110/300
6/6 [==============================] - 0s 624us/step - loss: 0.4105 - accuracy: 0.8087
Epoch 111/300
6/6 [==============================] - 0s 566us/step - loss: 0.4101 - accuracy: 0.8087
Epoch 112/300
6/6 [==============================] - 0s 586us/step - loss: 0.4094 - accuracy: 0.8058
Epoch 113/300
6/6 [==============================] - 0s 574us/step - loss: 0.4090 - accuracy: 0.8029
Epoch 114/300
6/6 [==============================] - 0s 601us/step - loss: 0.4086 - accuracy: 0.8029
Epoch 115/300
6/6 [==============================] - 0s 584us/step - loss: 0.4078 - accuracy: 0.8029
Epoch 116/300
6/6 [==============================] - 0s 598us/step - loss: 0.4073 - accuracy: 0.8058
Epoch 117/300
6/6 [==============================] - 0s 547us/step - loss: 0.4068 - accuracy: 0.8058
Epoch 118/300
6/6 [==============================] - 0s 589us/step - loss: 0.4065 - accuracy: 0.8058
Epoch 119/300
6/6 [==============================] - 0s 559us/step - loss: 0.4059 - accuracy: 0.8058
Epoch 120/300
6/6 [==============================] - 0s 544us/step - loss: 0.4055 - accuracy: 0.8058
Epoch 121/300
6/6 [==============================] - 0s 552us/step - loss: 0.4050 - accuracy: 0.8058
Epoch 122/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4048 - accuracy: 0.8058
Epoch 123/300
6/6 [==============================] - 0s 556us/step - loss: 0.4042 - accuracy: 0.8058
Epoch 124/300
6/6 [==============================] - 0s 548us/step - loss: 0.4040 - accuracy: 0.8058
Epoch 125/300
6/6 [==============================] - 0s 581us/step - loss: 0.4034 - accuracy: 0.8058
Epoch 126/300
6/6 [==============================] - 0s 13ms/step - loss: 0.4030 - accuracy: 0.8087
Epoch 127/300
6/6 [==============================] - 0s 604us/step - loss: 0.4026 - accuracy: 0.8087
Epoch 128/300
6/6 [==============================] - 0s 600us/step - loss: 0.4021 - accuracy: 0.8029
Epoch 129/300
6/6 [==============================] - 0s 575us/step - loss: 0.4017 - accuracy: 0.8000
Epoch 130/300
6/6 [==============================] - 0s 578us/step - loss: 0.4013 - accuracy: 0.8000
Epoch 131/300
6/6 [==============================] - 0s 594us/step - loss: 0.4008 - accuracy: 0.8000
Epoch 132/300
6/6 [==============================] - 0s 581us/step - loss: 0.4003 - accuracy: 0.8029
Epoch 133/300
6/6 [==============================] - 0s 595us/step - loss: 0.4000 - accuracy: 0.8029
Epoch 134/300
6/6 [==============================] - 0s 565us/step - loss: 0.3996 - accuracy: 0.8029
Epoch 135/300
6/6 [==============================] - 0s 603us/step - loss: 0.3991 - accuracy: 0.8087
Epoch 136/300
6/6 [==============================] - 0s 587us/step - loss: 0.3988 - accuracy: 0.8058
Epoch 137/300
6/6 [==============================] - 0s 594us/step - loss: 0.3984 - accuracy: 0.8058
Epoch 138/300
6/6 [==============================] - 0s 579us/step - loss: 0.3979 - accuracy: 0.8058
Epoch 139/300
6/6 [==============================] - 0s 624us/step - loss: 0.3975 - accuracy: 0.8058
Epoch 140/300
6/6 [==============================] - 0s 621us/step - loss: 0.3971 - accuracy: 0.8058
Epoch 141/300
6/6 [==============================] - 0s 585us/step - loss: 0.3967 - accuracy: 0.8058
Epoch 142/300
6/6 [==============================] - 0s 585us/step - loss: 0.3964 - accuracy: 0.8058
Epoch 143/300
6/6 [==============================] - 0s 567us/step - loss: 0.3960 - accuracy: 0.8087
Epoch 144/300
6/6 [==============================] - 0s 595us/step - loss: 0.3956 - accuracy: 0.8087
Epoch 145/300
6/6 [==============================] - 0s 597us/step - loss: 0.3951 - accuracy: 0.8087
Epoch 146/300
6/6 [==============================] - 0s 566us/step - loss: 0.3948 - accuracy: 0.8058
Epoch 147/300
6/6 [==============================] - 0s 592us/step - loss: 0.3945 - accuracy: 0.8058
Epoch 148/300
6/6 [==============================] - 0s 609us/step - loss: 0.3942 - accuracy: 0.8058
Epoch 149/300
6/6 [==============================] - 0s 592us/step - loss: 0.3937 - accuracy: 0.8058
Epoch 150/300
6/6 [==============================] - 0s 581us/step - loss: 0.3936 - accuracy: 0.8000
Epoch 151/300
6/6 [==============================] - 0s 599us/step - loss: 0.3934 - accuracy: 0.7971
Epoch 152/300
6/6 [==============================] - 0s 606us/step - loss: 0.3929 - accuracy: 0.7971
Epoch 153/300
6/6 [==============================] - 0s 612us/step - loss: 0.3929 - accuracy: 0.7971
Epoch 154/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3924 - accuracy: 0.7971
Epoch 155/300
6/6 [==============================] - 0s 621us/step - loss: 0.3924 - accuracy: 0.8000
Epoch 156/300
6/6 [==============================] - 0s 680us/step - loss: 0.3916 - accuracy: 0.8029
Epoch 157/300
6/6 [==============================] - 0s 731us/step - loss: 0.3913 - accuracy: 0.8058
Epoch 158/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3911 - accuracy: 0.8058
Epoch 159/300
6/6 [==============================] - 0s 626us/step - loss: 0.3909 - accuracy: 0.8058
Epoch 160/300
6/6 [==============================] - 0s 604us/step - loss: 0.3906 - accuracy: 0.8058
Epoch 161/300
6/6 [==============================] - 0s 593us/step - loss: 0.3901 - accuracy: 0.8058
Epoch 162/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3900 - accuracy: 0.8087
Epoch 163/300
6/6 [==============================] - 0s 583us/step - loss: 0.3898 - accuracy: 0.8058
Epoch 164/300
6/6 [==============================] - 0s 577us/step - loss: 0.3895 - accuracy: 0.8058
Epoch 165/300
6/6 [==============================] - 0s 563us/step - loss: 0.3894 - accuracy: 0.8058
Epoch 166/300
6/6 [==============================] - 0s 586us/step - loss: 0.3890 - accuracy: 0.8087
Epoch 167/300
6/6 [==============================] - 0s 594us/step - loss: 0.3886 - accuracy: 0.8087
Epoch 168/300
6/6 [==============================] - 0s 585us/step - loss: 0.3882 - accuracy: 0.8087
Epoch 169/300
6/6 [==============================] - 0s 584us/step - loss: 0.3882 - accuracy: 0.8058
Epoch 170/300
6/6 [==============================] - 0s 588us/step - loss: 0.3878 - accuracy: 0.8087
Epoch 171/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3878 - accuracy: 0.8116
Epoch 172/300
6/6 [==============================] - 0s 600us/step - loss: 0.3873 - accuracy: 0.8087
Epoch 173/300
6/6 [==============================] - 0s 589us/step - loss: 0.3871 - accuracy: 0.8116
Epoch 174/300
6/6 [==============================] - 0s 575us/step - loss: 0.3868 - accuracy: 0.8116
Epoch 175/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3866 - accuracy: 0.8116
Epoch 176/300
6/6 [==============================] - 0s 606us/step - loss: 0.3865 - accuracy: 0.8116
Epoch 177/300
6/6 [==============================] - 0s 595us/step - loss: 0.3862 - accuracy: 0.8116
Epoch 178/300
6/6 [==============================] - 0s 616us/step - loss: 0.3860 - accuracy: 0.8087
Epoch 179/300
6/6 [==============================] - 0s 617us/step - loss: 0.3858 - accuracy: 0.8087
Epoch 180/300
6/6 [==============================] - 0s 598us/step - loss: 0.3855 - accuracy: 0.8058
Epoch 181/300
6/6 [==============================] - 0s 591us/step - loss: 0.3854 - accuracy: 0.8058
Epoch 182/300
6/6 [==============================] - 0s 593us/step - loss: 0.3851 - accuracy: 0.8058
Epoch 183/300
6/6 [==============================] - 0s 625us/step - loss: 0.3848 - accuracy: 0.8058
Epoch 184/300
6/6 [==============================] - 0s 586us/step - loss: 0.3845 - accuracy: 0.8058
Epoch 185/300
6/6 [==============================] - 0s 592us/step - loss: 0.3842 - accuracy: 0.8058
Epoch 186/300
6/6 [==============================] - 0s 569us/step - loss: 0.3841 - accuracy: 0.8058
Epoch 187/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3838 - accuracy: 0.8058
Epoch 188/300
6/6 [==============================] - 0s 569us/step - loss: 0.3835 - accuracy: 0.8029
Epoch 189/300
6/6 [==============================] - 0s 573us/step - loss: 0.3835 - accuracy: 0.8029
Epoch 190/300
6/6 [==============================] - 0s 588us/step - loss: 0.3831 - accuracy: 0.8058
Epoch 191/300
6/6 [==============================] - 0s 612us/step - loss: 0.3827 - accuracy: 0.8087
Epoch 192/300
6/6 [==============================] - 0s 595us/step - loss: 0.3829 - accuracy: 0.8029
Epoch 193/300
6/6 [==============================] - 0s 604us/step - loss: 0.3825 - accuracy: 0.8058
Epoch 194/300
6/6 [==============================] - 0s 609us/step - loss: 0.3820 - accuracy: 0.8029
Epoch 195/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3817 - accuracy: 0.8000
Epoch 196/300
6/6 [==============================] - 0s 597us/step - loss: 0.3815 - accuracy: 0.8000
Epoch 197/300
6/6 [==============================] - 0s 582us/step - loss: 0.3813 - accuracy: 0.8029
Epoch 198/300
6/6 [==============================] - 0s 604us/step - loss: 0.3810 - accuracy: 0.8029
Epoch 199/300
6/6 [==============================] - 0s 654us/step - loss: 0.3808 - accuracy: 0.8029
Epoch 200/300
6/6 [==============================] - 0s 600us/step - loss: 0.3806 - accuracy: 0.8029
Epoch 201/300
6/6 [==============================] - 0s 575us/step - loss: 0.3802 - accuracy: 0.8029
Epoch 202/300
6/6 [==============================] - 0s 579us/step - loss: 0.3802 - accuracy: 0.8029
Epoch 203/300
6/6 [==============================] - 0s 574us/step - loss: 0.3799 - accuracy: 0.8029
Epoch 204/300
6/6 [==============================] - 0s 558us/step - loss: 0.3796 - accuracy: 0.8058
Epoch 205/300
6/6 [==============================] - 0s 563us/step - loss: 0.3792 - accuracy: 0.8058
Epoch 206/300
6/6 [==============================] - 0s 558us/step - loss: 0.3791 - accuracy: 0.8058
Epoch 207/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3788 - accuracy: 0.8029
Epoch 208/300
6/6 [==============================] - 0s 573us/step - loss: 0.3786 - accuracy: 0.8029
Epoch 209/300
6/6 [==============================] - 0s 565us/step - loss: 0.3783 - accuracy: 0.8029
Epoch 210/300
6/6 [==============================] - 0s 557us/step - loss: 0.3783 - accuracy: 0.8029
Epoch 211/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3779 - accuracy: 0.8029
Epoch 212/300
6/6 [==============================] - 0s 578us/step - loss: 0.3777 - accuracy: 0.8029
Epoch 213/300
6/6 [==============================] - 0s 559us/step - loss: 0.3775 - accuracy: 0.8029
Epoch 214/300
6/6 [==============================] - 0s 568us/step - loss: 0.3773 - accuracy: 0.8029
Epoch 215/300
6/6 [==============================] - 0s 543us/step - loss: 0.3769 - accuracy: 0.8029
Epoch 216/300
6/6 [==============================] - 0s 578us/step - loss: 0.3769 - accuracy: 0.8029
Epoch 217/300
6/6 [==============================] - 0s 553us/step - loss: 0.3767 - accuracy: 0.8029
Epoch 218/300
6/6 [==============================] - 0s 553us/step - loss: 0.3764 - accuracy: 0.8058
Epoch 219/300
6/6 [==============================] - 0s 569us/step - loss: 0.3762 - accuracy: 0.8058
Epoch 220/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3761 - accuracy: 0.8087
Epoch 221/300
6/6 [==============================] - 0s 573us/step - loss: 0.3757 - accuracy: 0.8087
Epoch 222/300
6/6 [==============================] - 0s 560us/step - loss: 0.3754 - accuracy: 0.8087
Epoch 223/300
6/6 [==============================] - 0s 564us/step - loss: 0.3754 - accuracy: 0.8058
Epoch 224/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3752 - accuracy: 0.8087
Epoch 225/300
6/6 [==============================] - 0s 568us/step - loss: 0.3748 - accuracy: 0.8087
Epoch 226/300
6/6 [==============================] - 0s 555us/step - loss: 0.3748 - accuracy: 0.8058
Epoch 227/300
6/6 [==============================] - 0s 557us/step - loss: 0.3746 - accuracy: 0.8087
Epoch 228/300
6/6 [==============================] - 0s 560us/step - loss: 0.3740 - accuracy: 0.8087
Epoch 229/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3740 - accuracy: 0.8116
Epoch 230/300
6/6 [==============================] - 0s 560us/step - loss: 0.3740 - accuracy: 0.8058
Epoch 231/300
6/6 [==============================] - 0s 558us/step - loss: 0.3736 - accuracy: 0.8087
Epoch 232/300
6/6 [==============================] - 0s 564us/step - loss: 0.3736 - accuracy: 0.8058
Epoch 233/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3733 - accuracy: 0.8087
Epoch 234/300
6/6 [==============================] - 0s 566us/step - loss: 0.3732 - accuracy: 0.8087
Epoch 235/300
6/6 [==============================] - 0s 563us/step - loss: 0.3728 - accuracy: 0.8087
Epoch 236/300
6/6 [==============================] - 0s 563us/step - loss: 0.3724 - accuracy: 0.8058
Epoch 237/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3727 - accuracy: 0.8087
Epoch 238/300
6/6 [==============================] - 0s 565us/step - loss: 0.3728 - accuracy: 0.8116
Epoch 239/300
6/6 [==============================] - 0s 567us/step - loss: 0.3723 - accuracy: 0.8116
Epoch 240/300
6/6 [==============================] - 0s 549us/step - loss: 0.3722 - accuracy: 0.8116
Epoch 241/300
6/6 [==============================] - 0s 555us/step - loss: 0.3717 - accuracy: 0.8116
Epoch 242/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3714 - accuracy: 0.8087
Epoch 243/300
6/6 [==============================] - 0s 582us/step - loss: 0.3712 - accuracy: 0.8058
Epoch 244/300
6/6 [==============================] - 0s 557us/step - loss: 0.3710 - accuracy: 0.8087
Epoch 245/300
6/6 [==============================] - 0s 569us/step - loss: 0.3708 - accuracy: 0.8116
Epoch 246/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3705 - accuracy: 0.8116
Epoch 247/300
6/6 [==============================] - 0s 565us/step - loss: 0.3704 - accuracy: 0.8116
Epoch 248/300
6/6 [==============================] - 0s 553us/step - loss: 0.3701 - accuracy: 0.8116
Epoch 249/300
6/6 [==============================] - 0s 555us/step - loss: 0.3700 - accuracy: 0.8116
Epoch 250/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3700 - accuracy: 0.8116
Epoch 251/300
6/6 [==============================] - 0s 571us/step - loss: 0.3698 - accuracy: 0.8116
Epoch 252/300
6/6 [==============================] - 0s 566us/step - loss: 0.3697 - accuracy: 0.8116
Epoch 253/300
6/6 [==============================] - 0s 560us/step - loss: 0.3693 - accuracy: 0.8116
Epoch 254/300
6/6 [==============================] - 0s 548us/step - loss: 0.3690 - accuracy: 0.8116
Epoch 255/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3688 - accuracy: 0.8145
Epoch 256/300
6/6 [==============================] - 0s 573us/step - loss: 0.3687 - accuracy: 0.8116
Epoch 257/300
6/6 [==============================] - 0s 558us/step - loss: 0.3684 - accuracy: 0.8145
Epoch 258/300
6/6 [==============================] - 0s 555us/step - loss: 0.3682 - accuracy: 0.8145
Epoch 259/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3682 - accuracy: 0.8145
Epoch 260/300
6/6 [==============================] - 0s 571us/step - loss: 0.3679 - accuracy: 0.8145
Epoch 261/300
6/6 [==============================] - 0s 565us/step - loss: 0.3677 - accuracy: 0.8116
Epoch 262/300
6/6 [==============================] - 0s 581us/step - loss: 0.3677 - accuracy: 0.8116
Epoch 263/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3674 - accuracy: 0.8145
Epoch 264/300
6/6 [==============================] - 0s 578us/step - loss: 0.3673 - accuracy: 0.8145
Epoch 265/300
6/6 [==============================] - 0s 572us/step - loss: 0.3673 - accuracy: 0.8145
Epoch 266/300
6/6 [==============================] - 0s 555us/step - loss: 0.3667 - accuracy: 0.8145
Epoch 267/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3666 - accuracy: 0.8174
Epoch 268/300
6/6 [==============================] - 0s 567us/step - loss: 0.3664 - accuracy: 0.8174
Epoch 269/300
6/6 [==============================] - 0s 559us/step - loss: 0.3662 - accuracy: 0.8174
Epoch 270/300
6/6 [==============================] - 0s 558us/step - loss: 0.3663 - accuracy: 0.8174
Epoch 271/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3657 - accuracy: 0.8174
Epoch 272/300
6/6 [==============================] - 0s 561us/step - loss: 0.3654 - accuracy: 0.8174
Epoch 273/300
6/6 [==============================] - 0s 558us/step - loss: 0.3653 - accuracy: 0.8174
Epoch 274/300
6/6 [==============================] - 0s 553us/step - loss: 0.3653 - accuracy: 0.8203
Epoch 275/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3650 - accuracy: 0.8174
Epoch 276/300
6/6 [==============================] - 0s 565us/step - loss: 0.3648 - accuracy: 0.8145
Epoch 277/300
6/6 [==============================] - 0s 565us/step - loss: 0.3644 - accuracy: 0.8145
Epoch 278/300
6/6 [==============================] - 0s 558us/step - loss: 0.3642 - accuracy: 0.8116
Epoch 279/300
6/6 [==============================] - 0s 571us/step - loss: 0.3641 - accuracy: 0.8145
Epoch 280/300
6/6 [==============================] - 0s 681us/step - loss: 0.3636 - accuracy: 0.8145
Epoch 281/300
6/6 [==============================] - 0s 565us/step - loss: 0.3636 - accuracy: 0.8145
Epoch 282/300
6/6 [==============================] - 0s 553us/step - loss: 0.3634 - accuracy: 0.8145
Epoch 283/300
6/6 [==============================] - 0s 560us/step - loss: 0.3630 - accuracy: 0.8174
Epoch 284/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3630 - accuracy: 0.8174
Epoch 285/300
6/6 [==============================] - 0s 562us/step - loss: 0.3626 - accuracy: 0.8174
Epoch 286/300
6/6 [==============================] - 0s 562us/step - loss: 0.3625 - accuracy: 0.8203
Epoch 287/300
6/6 [==============================] - 0s 558us/step - loss: 0.3623 - accuracy: 0.8203
Epoch 288/300
6/6 [==============================] - 0s 14ms/step - loss: 0.3620 - accuracy: 0.8203
Epoch 289/300
6/6 [==============================] - 0s 573us/step - loss: 0.3618 - accuracy: 0.8174
Epoch 290/300
6/6 [==============================] - 0s 547us/step - loss: 0.3618 - accuracy: 0.8174
Epoch 291/300
6/6 [==============================] - 0s 536us/step - loss: 0.3614 - accuracy: 0.8174
Epoch 292/300
6/6 [==============================] - 0s 541us/step - loss: 0.3612 - accuracy: 0.8174
Epoch 293/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3609 - accuracy: 0.8174
Epoch 294/300
6/6 [==============================] - 0s 575us/step - loss: 0.3608 - accuracy: 0.8174
Epoch 295/300
6/6 [==============================] - 0s 554us/step - loss: 0.3606 - accuracy: 0.8145
Epoch 296/300
6/6 [==============================] - 0s 567us/step - loss: 0.3603 - accuracy: 0.8145
Epoch 297/300
6/6 [==============================] - 0s 545us/step - loss: 0.3598 - accuracy: 0.8174
Epoch 298/300
6/6 [==============================] - 0s 13ms/step - loss: 0.3598 - accuracy: 0.8174
Epoch 299/300
6/6 [==============================] - 0s 536us/step - loss: 0.3593 - accuracy: 0.8203
Epoch 300/300
6/6 [==============================] - 0s 530us/step - loss: 0.3589 - accuracy: 0.8203

I used a different random state value for k fold cross validation because using the same value as train_test_split will generate the same set of random indices will be generated, which may result in the same data splits during both the train-test split and k-fold cross-validation. This could lead to overfitting, as the model will be evaluated on same data that it has already seen during training.

In [34]:
print("Mean Accuracy: {:.2f} (+/- {:.2f})".format(scores['test_accuracy'].mean(), scores['test_accuracy'].std()))
print("Mean F1 score: {:.2f} (+/- {:.2f})".format(scores['test_f1_macro'].mean(), scores['test_f1_macro'].std()))
print("Mean Precision: {:.2f} (+/- {:.2f})".format(scores['test_precision_macro'].mean(), scores['test_precision_macro'].std()))
print("Mean Recall: {:.2f} (+/- {:.2f})".format(scores['test_recall_macro'].mean(), scores['test_recall_macro'].std()))
Mean Accuracy: 0.76 (+/- 0.07)
Mean F1 score: 0.72 (+/- 0.06)
Mean Precision: 0.74 (+/- 0.07)
Mean Recall: 0.72 (+/- 0.05)
In [35]:
# Choosing the parameters that will be used in Grid Search CV

num_of_layers = [0, 1, 2]
optimizer = ['SGD', 'RMSprop', 'Adam']
learning_rate = [0.001, 0.0015, 0.003]
num_of_neurons = [4, 6, 8]
b_size =  [32, 64]
num_of_epochs = [100, 200]
params = dict(num_layers = num_of_layers,
              optimizer = optimizer,
              lrn_rate = learning_rate,
              neurons = num_of_neurons,
              batch_size = b_size,
              epochs = num_of_epochs )
In [36]:
########################### This code is commented out because it is computationally intensive to run ################

# #Perfoming Grid Search CV and fitting it on the training set

# #referenced from: Gaurav M., "How to find the optimum number of hidden layers and nodes in a neural network model?", 2019.[Online]
# #Available: https://datagraphi.com/blog/post/2019/12/17/how-to-find-the-optimum-number-of-hidden-layers-and-nodes-in-a-neural-network-model

# num_vals = 3
# grid_search = GridSearchCV(estimator = overfit_build,
#                            param_grid = params,
#                            cv = num_vals)
# grid_result = grid_search.fit(X_train_scaled,
#                               y_train)
In [38]:
# print("Best parameters: ", grid_result.best_params_)
# print("Best accuracy: {:.2f}%".format(grid_result.best_score_ * 100))

These were the best parameters and accuracy identified above in Grid Search CV. I have commented out the above code as it is compute intensive and took me approximately 1.15 hours to run and get the output.
Best parameters: {'batch_size': 64, 'epochs': 100, 'lrn_rate': 0.001, 'neurons': 8, 'num_layers': 0, 'optimizer': 'Adam'}
Best accuracy: 80.68%

I will improve on the overfitted model above and build the final model and reduce overfitting by using the optimal parameters discovered from Grid Search CV above. I will also add L2 regularization and early stopping to reduce overfitting. I tested L1 and Dropout regularization with different values but they are not giving the optimal score, hence in this case I am only using L2 regularization.

In [42]:
#Developing the final model
#Using the best parameters identified above in Grid Search CV

#Building the final model 
lrn_rate = 0.001

def final_model(optimizer='adam', l2 = 0.01):
    ann_final = models.Sequential()
    ann_final.add(layers.Dense(units = 8,
                                input_dim = 8,
                                activation = "relu",
                                kernel_initializer = GlorotUniform(seed = myState),
                                kernel_regularizer=regularizers.l2(l2)))

    ann_final.add(layers.Dense(units = 1,
                                activation = "sigmoid",
                                kernel_initializer = GlorotUniform(seed = myState), 
                                kernel_regularizer=regularizers.l2(l2)))
    ann_final.compile(optimizer = optimizer,
                        loss = "binary_crossentropy",
                        metrics = ["accuracy"])
    return ann_final
In [43]:
# Creating a variable to set the batch size and number of epochs
b_size = 64
num_epochs = 100

# Creating a KerasClassifier based on the final_model function
final_build = KerasClassifier(build_fn = final_model,
                                batch_size = b_size,
                                epochs = num_epochs)

#Adding early stopping to prevent overfitting
final_early_stopping = EarlyStopping(monitor='val_loss',
                               patience=5,
                               restore_best_weights=True)

#Fitting the model on the training and validation sets
final_history = final_build.fit(X_train_scaled, y_train, validation_data=(X_val_scaled, y_val), callbacks=[final_early_stopping])

# Evaluating the model on the training and validation sets
final_y_train_pred = final_build.predict(X_train_scaled)
final_y_val_pred = final_build.predict(X_val_scaled)

# Calculating the accuracy, F1 score, precision, and recall for training set
final_train_loss, final_train_accuracy = final_build.model.evaluate(X_train_scaled,
                                                                           y_train,
                                                                           verbose=False)
final_f1_train = f1_score(y_train, final_y_train_pred)
final_precision_train = precision_score(y_train, final_y_train_pred)
final_recall_train = recall_score(y_train, final_y_train_pred)


# Calculating the accuracy, F1 score, precision, and recall for the validation set
final_val_loss, final_val_accuracy = final_build.model.evaluate(X_val_scaled,
                                                                       y_val,
                                                                       verbose=False)
final_f1_val = f1_score(y_val, final_y_val_pred)
final_precision_val = precision_score(y_val, final_y_val_pred)
final_recall_val = recall_score(y_val, final_y_val_pred)
Epoch 1/100
6/6 [==============================] - 0s 36ms/step - loss: 0.8537 - accuracy: 0.5013 - val_loss: 0.8353 - val_accuracy: 0.5312
Epoch 2/100
6/6 [==============================] - 0s 3ms/step - loss: 0.8391 - accuracy: 0.5248 - val_loss: 0.8227 - val_accuracy: 0.5703
Epoch 3/100
6/6 [==============================] - 0s 14ms/step - loss: 0.8263 - accuracy: 0.5379 - val_loss: 0.8101 - val_accuracy: 0.5938
Epoch 4/100
6/6 [==============================] - 0s 2ms/step - loss: 0.8125 - accuracy: 0.5744 - val_loss: 0.7981 - val_accuracy: 0.6094
Epoch 5/100
6/6 [==============================] - 0s 15ms/step - loss: 0.8003 - accuracy: 0.5927 - val_loss: 0.7865 - val_accuracy: 0.6172
Epoch 6/100
6/6 [==============================] - 0s 2ms/step - loss: 0.7879 - accuracy: 0.6136 - val_loss: 0.7752 - val_accuracy: 0.6562
Epoch 7/100
6/6 [==============================] - 0s 14ms/step - loss: 0.7760 - accuracy: 0.6345 - val_loss: 0.7645 - val_accuracy: 0.6875
Epoch 8/100
6/6 [==============================] - 0s 14ms/step - loss: 0.7642 - accuracy: 0.6710 - val_loss: 0.7540 - val_accuracy: 0.7031
Epoch 9/100
6/6 [==============================] - 0s 3ms/step - loss: 0.7535 - accuracy: 0.6841 - val_loss: 0.7435 - val_accuracy: 0.7188
Epoch 10/100
6/6 [==============================] - 0s 15ms/step - loss: 0.7424 - accuracy: 0.6971 - val_loss: 0.7333 - val_accuracy: 0.7266
Epoch 11/100
6/6 [==============================] - 0s 2ms/step - loss: 0.7314 - accuracy: 0.7076 - val_loss: 0.7236 - val_accuracy: 0.7266
Epoch 12/100
6/6 [==============================] - 0s 14ms/step - loss: 0.7214 - accuracy: 0.7128 - val_loss: 0.7139 - val_accuracy: 0.7344
Epoch 13/100
6/6 [==============================] - 0s 14ms/step - loss: 0.7112 - accuracy: 0.7206 - val_loss: 0.7045 - val_accuracy: 0.7500
Epoch 14/100
6/6 [==============================] - 0s 2ms/step - loss: 0.7017 - accuracy: 0.7232 - val_loss: 0.6951 - val_accuracy: 0.7500
Epoch 15/100
6/6 [==============================] - 0s 14ms/step - loss: 0.6918 - accuracy: 0.7206 - val_loss: 0.6862 - val_accuracy: 0.7656
Epoch 16/100
6/6 [==============================] - 0s 2ms/step - loss: 0.6827 - accuracy: 0.7258 - val_loss: 0.6775 - val_accuracy: 0.7578
Epoch 17/100
6/6 [==============================] - 0s 15ms/step - loss: 0.6738 - accuracy: 0.7337 - val_loss: 0.6692 - val_accuracy: 0.7578
Epoch 18/100
6/6 [==============================] - 0s 3ms/step - loss: 0.6653 - accuracy: 0.7389 - val_loss: 0.6610 - val_accuracy: 0.7656
Epoch 19/100
6/6 [==============================] - 0s 14ms/step - loss: 0.6571 - accuracy: 0.7415 - val_loss: 0.6529 - val_accuracy: 0.7734
Epoch 20/100
6/6 [==============================] - 0s 2ms/step - loss: 0.6491 - accuracy: 0.7546 - val_loss: 0.6450 - val_accuracy: 0.7812
Epoch 21/100
6/6 [==============================] - 0s 14ms/step - loss: 0.6413 - accuracy: 0.7598 - val_loss: 0.6376 - val_accuracy: 0.7812
Epoch 22/100
6/6 [==============================] - 0s 2ms/step - loss: 0.6341 - accuracy: 0.7572 - val_loss: 0.6302 - val_accuracy: 0.7734
Epoch 23/100
6/6 [==============================] - 0s 2ms/step - loss: 0.6270 - accuracy: 0.7598 - val_loss: 0.6232 - val_accuracy: 0.7734
Epoch 24/100
6/6 [==============================] - 0s 2ms/step - loss: 0.6203 - accuracy: 0.7650 - val_loss: 0.6164 - val_accuracy: 0.7656
Epoch 25/100
6/6 [==============================] - 0s 2ms/step - loss: 0.6136 - accuracy: 0.7728 - val_loss: 0.6099 - val_accuracy: 0.7656
Epoch 26/100
6/6 [==============================] - 0s 14ms/step - loss: 0.6075 - accuracy: 0.7728 - val_loss: 0.6036 - val_accuracy: 0.7656
Epoch 27/100
6/6 [==============================] - 0s 2ms/step - loss: 0.6012 - accuracy: 0.7755 - val_loss: 0.5975 - val_accuracy: 0.7734
Epoch 28/100
6/6 [==============================] - 0s 14ms/step - loss: 0.5958 - accuracy: 0.7833 - val_loss: 0.5915 - val_accuracy: 0.7734
Epoch 29/100
6/6 [==============================] - 0s 3ms/step - loss: 0.5902 - accuracy: 0.7859 - val_loss: 0.5860 - val_accuracy: 0.7656
Epoch 30/100
6/6 [==============================] - 0s 13ms/step - loss: 0.5850 - accuracy: 0.7859 - val_loss: 0.5808 - val_accuracy: 0.7734
Epoch 31/100
6/6 [==============================] - 0s 3ms/step - loss: 0.5803 - accuracy: 0.7885 - val_loss: 0.5758 - val_accuracy: 0.7734
Epoch 32/100
6/6 [==============================] - 0s 14ms/step - loss: 0.5756 - accuracy: 0.7885 - val_loss: 0.5710 - val_accuracy: 0.7734
Epoch 33/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5714 - accuracy: 0.7937 - val_loss: 0.5665 - val_accuracy: 0.7734
Epoch 34/100
6/6 [==============================] - 0s 13ms/step - loss: 0.5676 - accuracy: 0.7963 - val_loss: 0.5621 - val_accuracy: 0.7734
Epoch 35/100
6/6 [==============================] - 0s 3ms/step - loss: 0.5636 - accuracy: 0.7963 - val_loss: 0.5580 - val_accuracy: 0.7734
Epoch 36/100
6/6 [==============================] - 0s 14ms/step - loss: 0.5600 - accuracy: 0.7990 - val_loss: 0.5541 - val_accuracy: 0.7734
Epoch 37/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5567 - accuracy: 0.7990 - val_loss: 0.5505 - val_accuracy: 0.7812
Epoch 38/100
6/6 [==============================] - 0s 13ms/step - loss: 0.5534 - accuracy: 0.8016 - val_loss: 0.5471 - val_accuracy: 0.7969
Epoch 39/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5504 - accuracy: 0.8016 - val_loss: 0.5440 - val_accuracy: 0.7969
Epoch 40/100
6/6 [==============================] - 0s 13ms/step - loss: 0.5478 - accuracy: 0.7937 - val_loss: 0.5408 - val_accuracy: 0.7891
Epoch 41/100
6/6 [==============================] - 0s 3ms/step - loss: 0.5453 - accuracy: 0.7937 - val_loss: 0.5379 - val_accuracy: 0.7812
Epoch 42/100
6/6 [==============================] - 0s 13ms/step - loss: 0.5427 - accuracy: 0.7963 - val_loss: 0.5350 - val_accuracy: 0.7812
Epoch 43/100
6/6 [==============================] - 0s 3ms/step - loss: 0.5404 - accuracy: 0.7963 - val_loss: 0.5326 - val_accuracy: 0.7812
Epoch 44/100
6/6 [==============================] - 0s 14ms/step - loss: 0.5380 - accuracy: 0.8016 - val_loss: 0.5303 - val_accuracy: 0.7812
Epoch 45/100
6/6 [==============================] - 0s 3ms/step - loss: 0.5361 - accuracy: 0.8016 - val_loss: 0.5281 - val_accuracy: 0.7812
Epoch 46/100
6/6 [==============================] - 0s 14ms/step - loss: 0.5343 - accuracy: 0.8016 - val_loss: 0.5260 - val_accuracy: 0.7812
Epoch 47/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5325 - accuracy: 0.8042 - val_loss: 0.5238 - val_accuracy: 0.7812
Epoch 48/100
6/6 [==============================] - 0s 13ms/step - loss: 0.5306 - accuracy: 0.8016 - val_loss: 0.5219 - val_accuracy: 0.7891
Epoch 49/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5288 - accuracy: 0.7963 - val_loss: 0.5202 - val_accuracy: 0.7812
Epoch 50/100
6/6 [==============================] - 0s 13ms/step - loss: 0.5272 - accuracy: 0.7963 - val_loss: 0.5186 - val_accuracy: 0.7812
Epoch 51/100
6/6 [==============================] - 0s 3ms/step - loss: 0.5259 - accuracy: 0.7937 - val_loss: 0.5169 - val_accuracy: 0.7812
Epoch 52/100
6/6 [==============================] - 0s 14ms/step - loss: 0.5242 - accuracy: 0.7937 - val_loss: 0.5156 - val_accuracy: 0.7891
Epoch 53/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5228 - accuracy: 0.7963 - val_loss: 0.5142 - val_accuracy: 0.7891
Epoch 54/100
6/6 [==============================] - 0s 14ms/step - loss: 0.5216 - accuracy: 0.7963 - val_loss: 0.5128 - val_accuracy: 0.7969
Epoch 55/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5201 - accuracy: 0.7990 - val_loss: 0.5117 - val_accuracy: 0.7969
Epoch 56/100
6/6 [==============================] - 0s 13ms/step - loss: 0.5188 - accuracy: 0.7990 - val_loss: 0.5106 - val_accuracy: 0.7969
Epoch 57/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5177 - accuracy: 0.8016 - val_loss: 0.5094 - val_accuracy: 0.7969
Epoch 58/100
6/6 [==============================] - 0s 3ms/step - loss: 0.5165 - accuracy: 0.8016 - val_loss: 0.5084 - val_accuracy: 0.7969
Epoch 59/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5154 - accuracy: 0.8042 - val_loss: 0.5074 - val_accuracy: 0.7969
Epoch 60/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5141 - accuracy: 0.8042 - val_loss: 0.5066 - val_accuracy: 0.7969
Epoch 61/100
6/6 [==============================] - 0s 3ms/step - loss: 0.5133 - accuracy: 0.8042 - val_loss: 0.5056 - val_accuracy: 0.7969
Epoch 62/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5122 - accuracy: 0.8042 - val_loss: 0.5048 - val_accuracy: 0.7969
Epoch 63/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5113 - accuracy: 0.8068 - val_loss: 0.5040 - val_accuracy: 0.7969
Epoch 64/100
6/6 [==============================] - 0s 13ms/step - loss: 0.5104 - accuracy: 0.8094 - val_loss: 0.5032 - val_accuracy: 0.7969
Epoch 65/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5094 - accuracy: 0.8094 - val_loss: 0.5024 - val_accuracy: 0.7969
Epoch 66/100
6/6 [==============================] - 0s 14ms/step - loss: 0.5086 - accuracy: 0.8094 - val_loss: 0.5017 - val_accuracy: 0.7969
Epoch 67/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5077 - accuracy: 0.8094 - val_loss: 0.5009 - val_accuracy: 0.7969
Epoch 68/100
6/6 [==============================] - 0s 14ms/step - loss: 0.5069 - accuracy: 0.8094 - val_loss: 0.5003 - val_accuracy: 0.7969
Epoch 69/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5061 - accuracy: 0.8094 - val_loss: 0.4997 - val_accuracy: 0.7969
Epoch 70/100
6/6 [==============================] - 0s 14ms/step - loss: 0.5053 - accuracy: 0.8094 - val_loss: 0.4992 - val_accuracy: 0.7969
Epoch 71/100
6/6 [==============================] - 0s 3ms/step - loss: 0.5045 - accuracy: 0.8094 - val_loss: 0.4985 - val_accuracy: 0.7969
Epoch 72/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5038 - accuracy: 0.8094 - val_loss: 0.4981 - val_accuracy: 0.7969
Epoch 73/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5030 - accuracy: 0.8094 - val_loss: 0.4975 - val_accuracy: 0.7969
Epoch 74/100
6/6 [==============================] - 0s 13ms/step - loss: 0.5023 - accuracy: 0.8094 - val_loss: 0.4970 - val_accuracy: 0.7969
Epoch 75/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5017 - accuracy: 0.8094 - val_loss: 0.4965 - val_accuracy: 0.7969
Epoch 76/100
6/6 [==============================] - 0s 14ms/step - loss: 0.5010 - accuracy: 0.8094 - val_loss: 0.4960 - val_accuracy: 0.7969
Epoch 77/100
6/6 [==============================] - 0s 2ms/step - loss: 0.5003 - accuracy: 0.8094 - val_loss: 0.4954 - val_accuracy: 0.7969
Epoch 78/100
6/6 [==============================] - 0s 14ms/step - loss: 0.4996 - accuracy: 0.8094 - val_loss: 0.4951 - val_accuracy: 0.7969
Epoch 79/100
6/6 [==============================] - 0s 3ms/step - loss: 0.4990 - accuracy: 0.8120 - val_loss: 0.4946 - val_accuracy: 0.7969
Epoch 80/100
6/6 [==============================] - 0s 3ms/step - loss: 0.4984 - accuracy: 0.8120 - val_loss: 0.4943 - val_accuracy: 0.7969
Epoch 81/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4978 - accuracy: 0.8120 - val_loss: 0.4939 - val_accuracy: 0.7969
Epoch 82/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4972 - accuracy: 0.8120 - val_loss: 0.4936 - val_accuracy: 0.7969
Epoch 83/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4967 - accuracy: 0.8120 - val_loss: 0.4933 - val_accuracy: 0.7969
Epoch 84/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4961 - accuracy: 0.8120 - val_loss: 0.4930 - val_accuracy: 0.7969
Epoch 85/100
6/6 [==============================] - 0s 3ms/step - loss: 0.4954 - accuracy: 0.8120 - val_loss: 0.4926 - val_accuracy: 0.7969
Epoch 86/100
6/6 [==============================] - 0s 3ms/step - loss: 0.4949 - accuracy: 0.8120 - val_loss: 0.4925 - val_accuracy: 0.7969
Epoch 87/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4943 - accuracy: 0.8120 - val_loss: 0.4922 - val_accuracy: 0.7891
Epoch 88/100
6/6 [==============================] - 0s 3ms/step - loss: 0.4938 - accuracy: 0.8120 - val_loss: 0.4920 - val_accuracy: 0.7891
Epoch 89/100
6/6 [==============================] - 0s 3ms/step - loss: 0.4933 - accuracy: 0.8120 - val_loss: 0.4918 - val_accuracy: 0.7891
Epoch 90/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4927 - accuracy: 0.8120 - val_loss: 0.4917 - val_accuracy: 0.7891
Epoch 91/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4922 - accuracy: 0.8120 - val_loss: 0.4915 - val_accuracy: 0.7891
Epoch 92/100
6/6 [==============================] - 0s 14ms/step - loss: 0.4917 - accuracy: 0.8120 - val_loss: 0.4913 - val_accuracy: 0.7812
Epoch 93/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4912 - accuracy: 0.8120 - val_loss: 0.4913 - val_accuracy: 0.7812
Epoch 94/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4908 - accuracy: 0.8120 - val_loss: 0.4911 - val_accuracy: 0.7812
Epoch 95/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4903 - accuracy: 0.8120 - val_loss: 0.4909 - val_accuracy: 0.7812
Epoch 96/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4898 - accuracy: 0.8120 - val_loss: 0.4908 - val_accuracy: 0.7812
Epoch 97/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4894 - accuracy: 0.8120 - val_loss: 0.4908 - val_accuracy: 0.7812
Epoch 98/100
6/6 [==============================] - 0s 13ms/step - loss: 0.4889 - accuracy: 0.8120 - val_loss: 0.4907 - val_accuracy: 0.7812
Epoch 99/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4885 - accuracy: 0.8146 - val_loss: 0.4906 - val_accuracy: 0.7812
Epoch 100/100
6/6 [==============================] - 0s 2ms/step - loss: 0.4881 - accuracy: 0.8146 - val_loss: 0.4905 - val_accuracy: 0.7734
In [44]:
# Print results for both training and validation sets for the overfit model
print("----------------------------")
print("Training accuracy: {:.2f}%".format(final_train_accuracy * 100))
print("Validation accuracy: {:.2f}%".format(final_val_accuracy * 100))
print("----------------------------")
print("Training F1 score: {:.2f}".format(final_f1_train))
print("Validation F1 score: {:.2f}".format(final_f1_val))
print("----------------------------")
print("Training precision: {:.2f}".format(final_precision_train))
print("Validation precision: {:.2f}".format(final_precision_val))
print("----------------------------")
print("Training recall: {:.2f}".format(final_recall_train))
print("Validation recall: {:.2f}".format(final_recall_val))
print("----------------------------")
----------------------------
Training accuracy: 81.46%
Validation accuracy: 77.34%
----------------------------
Training F1 score: 0.68
Validation F1 score: 0.61
----------------------------
Training precision: 0.78
Validation precision: 0.68
----------------------------
Training recall: 0.61
Validation recall: 0.56
----------------------------
In [45]:
# plotting the training and validation loss over each epoch
plt.plot(final_history.history['loss'])
plt.plot(final_history.history['val_loss'])
plt.title('Training and Validation Loss')
plt.xlabel('Epochs')
plt.ylabel('Loss')
plt.legend(['training', 'validation'],
           loc = 'upper right')
plt.show()

# plotting the training and validation accuracy over each epoch
plt.plot(final_history.history['accuracy'])
plt.plot(final_history.history['val_accuracy'])
plt.title('Training and Validation Accuracy')
plt.xlabel('Epochs')
plt.ylabel('Accuracy')
plt.legend(['training', 'validation'],
           loc = 'lower right')
plt.show()
In [46]:
# Evaluate the model on the test set
final_y_test_pred = final_build.predict(X_test_scaled)

# Calculating the accuracy, F1 score, precision, and recall for the validation set
final_test_loss, final_test_accuracy = final_build.model.evaluate(X_test_scaled,
                                                      y_test,
                                                      verbose=False)

final_f1_test = f1_score(y_test, final_y_test_pred)
final_precision_test = precision_score(y_test, final_y_test_pred)
final_recall_test = recall_score(y_test, final_y_test_pred)
In [47]:
# Print results for both training and validation sets for the overfit model
print("----------------------------")
print("Test accuracy: {:.2f}%".format(final_test_accuracy * 100))
print("Test F1 score: {:.2f}".format(final_f1_test))
print("Test precision: {:.2f}".format(final_precision_test))
print("Test recall: {:.2f}".format(final_recall_test))
print("----------------------------")
----------------------------
Test accuracy: 74.27%
Test F1 score: 0.56
Test precision: 0.61
Test recall: 0.52
----------------------------
In [50]:
#Building a confusion matrix for the test set
#referenced from: scikit-learn, "sklearn.metrics.confusion_matrix", 2023.[Online]
#Available: https://scikit-learn.org/stable/modules/generated/sklearn.metrics.confusion_matrix.html

final_pred_prob = final_build.predict(X_test_scaled)

# Using a threshold of 0.5 on the predicted probabilities to convert them into their respective classes
final_pred_classes = (final_pred_prob > 0.5).astype(int)

# Adding class labels to the confusion matrix
class_labels = ["negative", "positive"]

# Compute the confusion matrix
conf_matrix = confusion_matrix(y_test, final_pred_classes,  labels=[0, 1])
In [51]:
# Printing the confusion matrix with labels
print("Confusion matrix:")
print("                            Predicted","\n")
print("                   |  {}  |  {}".format(class_labels[0], class_labels[1]))
print("                   |------------------------")
print("          {} |     {}     |     {}".format(class_labels[0], conf_matrix[0][0], conf_matrix[0][1]))
print(" Actual            |------------|-----------")
print("          {} |     {}     |     {}".format(class_labels[1], conf_matrix[1][0], conf_matrix[1][1]))
Confusion matrix:
                            Predicted 

                   |  negative  |  positive
                   |------------------------
          negative |     99     |     18
 Actual            |------------|-----------
          positive |     26     |     28

Conclusion

The test set has an accuraccy of 74.27% as compared to 77.34% to the validation and 81.46% to the training sets. The dataset used only contains 768 records which is very small for a deep learning model to interpret and produce accurate results. This is why in this case the single layer perceptron model performs better than a Deep Neural Network. The test set score of 74.27% is pretty good. But as this deals with a very sensitive topic, it would not be recommended to use this model. This model would be very useful if more data is collected(preferably over several hundred thousand records) as it would be able to learn and accurately predict if the patient as diabetes or not. An accuracy of over 95% would be preferable for this topic, so that the patients can be identified correctly and treated in time for better results.

  • Outcome: The model has an accuracy score of 74.27% on the test set. This means that the model can accurately predict if a patient has diabetes or not accurately approximately 74% of the time.
  • No. of Hidden Layers: 0 - The Single Layer Perceptron model was identified to produce the best score(using gidsearchcv) as adding a hidden layer led to overfitting.
  • No. of Neurons For Input layers: 8 This was the best value identified by gridsearch which also produced the best result after personally testing with different values such as 2,4,6 and 16.
  • Optimizer: Adam
  • Learning Rate: 0.001 - The default learning rate value was identified to produce the best result after testing and also by using gridsearchcv.
  • Loss Function: Binary Cross Entropy - Because its a binary classification
  • Batch Size: 64
  • No. of Epochs: 100
  • Accuracy: The accuracy of the final model is 74.27% on the Training Set
  • F1 Score:The F1 score is 56% on the Test set. I used F1 score as there is an imabalanced distribution of classes.
  • Precision: The precision of the model on the Training set is 61%
  • Recall: The model can recall upto 52% on the Training set